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1. Basis of the report 



1. With regard to the elements of the international application:* 
[ | the international application as originally filed 
the description: 



pages 
pages 
pages 



(See Attached) 



_ , as originally filed 
filed with the demand 



filed with the letter of 



| x| the claims: 

pages 

pages 

pages 

pages 



(See Attached) 



, as originally filed 

as amended (together with any statement) under Article 19 
, filed with the demand 



, filed with the letter of 



| x| th e drawings: 



pages 
pages 
pages 



(See Attached) 



, as originally filed 

filed with the demand 



, filed with the letter of . 



I x| the sequence listing part of the description: 
pages (See Attached) 

pages 

pages __ _ 



, as originally filed 

, filed with the demand 



, filed with the letter of . 



2. With regard to the language, all the elements marked above were available or furnished to this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. . 
These elements were available or furnished to this Authority in the following language which is: 

| \ the language of a translation furnished for the purposes of international search (under Rule 23.1(b)). 

| | the language of publication of the international application (under Rule 48.3(b)). 

I I the language of the translation furnished for the purposes of international preliminary examination (under Rules 55.2 and/ 
or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 
preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in printed form. 
[ | filed together with the international application in computer readable form. 
| [ furnished subsequently to this Authority in written form. 
[ | furnished subsequently to this Authority in computer readable form 



□ 



The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the writen sequence listing has 
been furnished 

4 | x| The amendments have resulted in the cancellation of: 

[El the description, pages NONE 

[3 the claims, Nos. 15 and 28 



|~xl the drawings, sheetstf*£ NQNE 



5. [x] This report has been drawn as if (some of) the amendments had not been made, since they have been considered to go 

beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 
* Replacement sheets which have been furnished to die receiving Office in response to an invitation under Article 14 are referred to 

inthis report as "originally filed" and are not annexed to this report since they do not contain amendments (Rules 70.16 

and 70,17). 

*M/ry replacement sheet containing such amendments must be referred to under item 1 and annexed to this report. 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1. statement 

Novelty (N) 



Claims NONE 



Inventive Step (IS) 



Industrial Applicability (IA) 



Claims 1-14. 16-27, and 29-32 



Claims NONE 



Claims 1-14, 16-27, and 29-32 



Claims 1-14, 16-27, and 29-32 



Claims NONE 



YES 
NO 

YES 
NO 



YES 
NO 



2. citations and explanations (Rule 70.7) 

Claims 1-14 16-27 and 29-32 lack novelty under PCT Article 33(2) as being anticipated by Ben-Efraim (U.S. Pat. No. 
5 519 734) Ben-Efraim teaches or suggests the use of multiple concatenated coders connected by an interleaver. Ben-Efraim also 
teaches or suggests that the concatenated coders are either all convolutional or all non-convolutional. Ben-Efraim also teaches 
that using the concatenated code would allow the user to reduce the required power as per claims 18 and 31. See Fig. 1, and 
column 3, lines 32-61. 

Claims 1-14 16-27 and 29-32 lack novelty under PCT Article 33(2) as being anticipated by Hladik et al. (U.S. Pat. No. 5,721,745 
hereinafter Hladik)' Hladik teaches or suggests the use of multiple concatenated coders connected by an interleaver. Hladik also 
teaches or suggests that the concatenated coders are either all convolutional or all non-convolutional. See Fig 's 1 and 2, and 
column 2 line 41 - column 3. line 13. As per claims 18 and 31, the functions of "producing a peak reduced signal" (claims 18 
and 31) is equivalent to the function of "producing a symbol stream by forward error coding" (claims 1, 16, 19, ...) since they 
they are both being performed by the same exact procedure. 



NEW CITATIONS 



US 5,519,734 A (BEN-EFRAIM et al.) 21 May 1996, see Fig. 1, and column 3, lines 32-61. 
US 5,721,745 A (HLADIK et al.) 24 February 1998, see Fig.'s 1 and 2, and column 2, line 41 - column 41, line 13. 
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Continuation of: Boxes I - VIII 
I. BASIS OF REPORT: 

This report has been drawn on the basis of the description. 

page(s) 1-81, as originally filed. 

page(s) NONE, filed with the demand. 

and additional amendments: 

NONE 

This report has been drawn on the basis of the claims, 

page(s) NONE, as originally filed. 

page(s) NONE, as amended under Article 19. 

page(s) NONE, filed with the demand. 

and additional amendments: 

Pages 82-84, filed with the letter of 25 September 2000. 

This report has been drawn on the basis of the drawings. 
page<s) 1^*2, as originally filed. 
page(s) NONE, filed with the demand, 
and additional amendments: 



This report has been drawn on the basis of the sequence listing part of the description: 
page(s) NONE, as originally filed. 
pages(s) NONE, filed with the demand, 
and additional amendments: 



5. (Some) amendments are considered to go beyond the disclosure as filed: 
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What We Claim Is: 

1 . A method of forward error correction for communication systems, comprising the following steps: 
producing a symbol stream by forward error coding of a data stream; 

modulating said symbol stream to produce a modulated signal; and, 
5 transmitting said modulated signal over a communication link. 

2. The method recited in Claim I wherein said communication system is a wired system. 

3. The method recited in Claim 1 wherein said communication system is an optical system. 

4. The method recited in Claim 1 wherein the modulating is accomplished with a multicarrier method. 

5. The method recited in Claim 4 wherein the multicarrier method is a Discrete Multi-Tone (DMT) method. 

10 6. The method recited in Claim 1 wherein the modulating is accomplished with a CAP-QAM single carrier method. 

7. The method recited in Claim 1 wherein the modulating is accomplished with a Quadrature Amplitude Modulation 
(QAM) method. 

8. The method recited in Claim 1 wherein the modulating is accomplished using a Pulse Amplitude Modulation (PAM) 
method. 

15 9. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 

stream is accomplished with a plurality of convolutional coders. 

10. The method recited in Claim 9 wherein the plurality of convolutional coders are configured in parallel. 

1 1 . The method recited in Claim 9 wherein the plurality of convolutional coders are configured in series. 

12. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 
20 stream is accomplished with a plurality of non-convolutional coders. 

13. The method recited in Claim 12 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

14. The method recited in Claim 12 wherein said non-convolutional coder comprises a low density parity check encoder. 

15. The method recited in Claim 12 wherein the plurality of non-convolutional coders are configured in series. 

16. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 
2 5 stream is accomplished with a non-convolutional coder and a plurality of convolutional coders. 

17. The method recited in Claim 16 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

18. A method of peak power level reduction for communication systems utilizing a plurality of coders comprising the 
following steps: 

producing a peak reduced signal by encoding said data stream by said plurality of coders; 
30 modulating said peak reduced signal; and, 

transmitting the modulated peak reduced signal. 

1 9. A method of forward error correction for communication systems, comprising the following steps: 
producing a symbol stream by forward error coding of a data stream; 

modulating said symbol stream to produce a modulated signal; 
35 transmitting said modulated signal over a communication link; 

receiving said modulated signal, where said received modulated signal includes errors; 
demodulating said received signal which includes errors; 
decoding said demodulated signal by a plurality of convolutional decoders; and, 
regenerating said data stream and eliminating said errors. 
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20. A method of forward error correction for communication systems, comprising the following steps: 

receiving a modulated signal from a communications link, where said received modulated signal includes errors; 

demodulating said received signal which includes errors; 

decoding said demodulated signal by a plurality of convolutional decoders; and, 

regenerating said data stream and eliminating said errors. 

21. An apparatus for forward error correction for communication systems, comprising: 
means for producing a symbol stream by forward error coding of a data stream; 
means for modulating said symbol stream to produce a modulated signal; and, 
means for transmitting said modulated signal over a communication link. 

22. The apparatus recited in Claim 21 wherein said communication system is a wired system. 

23. The apparatus recited in Claim 2 1 wherein said communication system is an optical system. 

24. The apparatus recited in Claim 2 1 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a plurality of convolutional coders. 

25. The apparatus recited in Claim 24 wherein the plurality of convolutional coders are configured in parallel. 

26. The apparatus recited in Claim 24 wherein the plurality of convolutional coders are configured in series. 

27. The apparatus recited in Claim 2 1 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a plurality of non-convolutional coders. 

28. The apparatus recited in Claim 27 wherein the plurality of non-convolutional coders are configured in series. 

29. The apparatus recited in Claim 2 1 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a non-convolutional coder and a plurality of convolutional coders. 

30. The apparatus recited in Claim 29 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

31. An apparatus for accomplishing peak power level reduction for communication systems utilizing a plurality of coders 
comprising; 

means for producing a peak reduced signal by encoding said data stream by said plurality of coders; 
means for modulating said peak reduced signal; and, 
means for transmitting the modulated peak reduced signal. 

32. An apparatus for forward error correction for communication systems, comprising: 

means for receiving a modulated signal from a communications link, where said received modulated signal includes 

errors; 

means for demodulating said received signal which includes errors; 

means for decoding said demodulated signal by a plurality of convolutional decoders, and, 

means for regenerating said data stream and eliminating said errors. 
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What We Claim Is: * 

1 . A method of forward error correction for communication systems, comprising: 

producing a symbol stream by forward error coding of a data stream using multiple concatenated coders connected 
by an interleaver, all of the concatenated coders being of a single type that is one of convolutional and non-convolutional; 
modulating said symbol stream to produce a modulated signal; and, 
transmitting said modulated signal over a communication link. 

2. The method recited in Claim 1 wherein said communication system is a wired system. 

3. The method recited in Claim 1 wherein said communication system is an optical system. 

4. The method recited in Claim 1 wherein the modulating is accomplished with a multicarrier method. 

5. The method recited in Claim 4 wherein the multicarrier method is a Discrete Multi-Tone (DMT) 



method. 



method. 



The method recited in Claim 1 wherein the modulating is accomplished with a CAP-QAM single carrier 



7. The method recited in Claim 1 wherein the modulating is accomplished with a Quadrature Amplitude 
Modulation (QAM) method. 

8. The method recited in Claim 1 wherein the modulating is accomplished using a Pulse Amplitude 
Modulation (PAM) method. 

9. The method recited in Claim 1 wherein said multiple concatenated coders are convolutional coders. 

1 0. The method recited in Claim 1 wherein a first of the concatenated coders is configured in parallel with 
the interleaver and a second of the concatenated coders. 

1 1 . The method recited in Claim 1 wherein a first of the concatenated coders is configured in series with the 
interleaver and a second of the concatenated coders. 

12. The method recited in Claim I wherein said multiple concatenated coders are non-convolutional coders. 

13. The method recited in Claim 12 wherein one of said non-convolutional coders comprises a Reed- 
Solomon encoder. 

14. The method recited in Claim 12 wherein one of said non-convolutional coders comprises a low density 
parity check encoder. 

16. A method of forward error correction for communication systems, comprising: 

producing a symbol stream by forward error coding of a data stream using an outer level non-convolutional coder 
and an inner level coder comprising multiple concatenated coders connected by an interleaver, all of the concatenated coders 
being of a single type that is one of convolutional and non-convolutional; 

modulating said symbol stream to produce a modulated signal; and, 

transmitting said modulated signal over a communication link. 

17. The method recited in Claim 16 wherein said outer level coder comprises a Reed-Solomon Encoder. 

1 8. A method of peak power level reduction for communication systems utilizing a plurality of coders 
comprising the following steps: 

producing a peak reduced signal by encoding said data stream by said plurality of coders; 
modulating said peak reduced signal; and, 
transmitting the modulated peak reduced signal: 

19. A method of forward error correction for communication systems, comprising the following steps: 
producing a symbol stream by forward error coding of a data stream using multiple concatenated coders connected 

by an interleaver, all of the concatenated coders being of a single type that is one of convolutional and non-convolutional; 
modulating said symbol stream to produce a modulated signal; 
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transmitting said modulated signal over a communication link; ~ 
receiving said modulated signal, where said received modulated signal includes errors; 
demodulating said received signal which includes errors; 

iteratively decoding said demodulated signal using multiple concatenated decoders connected by an interleave! 
5 and a de- interleave^ all of the concatenated decoders being of the same type as the concatenated coders; and, 
regenerating said data stream and eliminating said errors. 

20. A method of forward error correction for communication systems, comprising: 

receiving a modulated signal from a communications link, where said received modulated signal includes errors; 
demodulating said received signal which includes errors; 
10 iteratively decoding said demodulated signal using multiple concatenated decoders connected by an interleaver 

and a de-interleaver, all of the concatenated decoders being of a single type that is one of convolutional and non- 
convolutional; and, 

regenerating said data stream and eliminating said errors. 

21. An apparatus for forward error correction for communication systems, comprising: 

15 multiple concatenated coders connected by an interleaver for producing a symbol stream by forward error coding 

of a data stream, all of the concatenated coders being of a single type that is one of convolutional and non-convolutional,; 
a modulator for modulating said symbol stream to produce a modulated signal; and, 
a transmitter for transmitting said modulated signal over a communication link. 

22. The apparatus recited in Claim 21 wherein said communication system is a wired system. 
20 23. The apparatus recited in Claim 21 wherein said communication system is an optical system. 

24. The apparatus recited in Claim 21 wherein said multiple concatenated coders are convolutional coders. 

25. The apparatus recited in Claim 2 1 wherein a first of the concatenated coders is configured in parallel 
with the interleaver and a second of the concatenated coders. 

26. The apparatus recited in Claim 21 wherein a first of the concatenated coders is configured in series with 
25 the interleaver and a second of the concatenated coders. 

27. The apparatus recited in Claim 2 1 wherein said multiple concatenated coders are non-convolutional 

coders. 

29. An apparatus for forward error correction for communication systems, comprising: 
an outer level non-convolutional coder and an inner level coder comprising multiple concatenated coders 

30 connected by an interleaver for producing a symbol stream by forward error coding of a data stream, all of the concatenated 
coders being of a single type that is one of convolutional and non-convolutional; 

a modulator for modulating said symbol stream to produce a modulated signal; and, 
a transmitter for transmitting said modulated signal over a communication link. 

30. The apparatus recited in Claim 29 wherein said outer level coder comprises a Reed-Solomon encoder. 
35 31. An apparatus for accomplishing peak power level reduction for communication systems utilizing a 

plurality of coders comprising: 

means for producing a peak reduced signal by encoding said data stream by said plurality of coders; 
means for modulating said peak reduced signal; and, 
means for transmitting the modulated peak reduced signal. 



32. An apparatus for forward error correction for communication systems, comprising: 
a receiver for receiving a modulated signal from a communications link, where said received modulated signal 
includes errors; 
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a demodulator for demodulating said received signal which includes errors; 

multiple concatenated decoders connected by an interleaver and a de-interleaver for iteratively decoding said 
demodulated signal, all of the concatenated decoders being of a single type -that is one of convolutional and non- 
convolutional; and, 

means for regenerating said data stream and eliminating said errors. 
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1. With regard to the elements of the international application: * 
| x | the international application as originally filed 
the description: 
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pages 
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filed with the demand 
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, filed with the letter of 



[ x| the claims: 

pages 82-83 
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, as amended (together with any statement) under Article 19 
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[ x| the drawings: 
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filed with the letter of . 



| x| the sequence listing part of the description: 
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pages 
pages 
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, as originally filed 

filed with the demand 



NONE 



filed with the letter of 



2. With regard to the language, all the elements marked above were available or furnished to this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 

| | the language of a translation furnished for the purposes of international search (under Rule 23 .1(b)). 
| | the language of publication of the international application (under Rule 48.3(b)). 

| | the language of the translation furnished for the purposes of international preliminary examination (under Rules 55.2 and/ 
or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the written opinion was 
drawn on the basis of the sequence listing: 

contained in the international application in printed form. 
| | filed together with the international application in computer readable form. 
| | furnished subsequently to this Authority in written form. 
| | furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

I I The statement that the information recorded in computer readable form is identical to the writen sequence listing lias 
' — ' been furnished. 

4 I xl The amendments have resulted in the cancellation of: 

CE1 the description, pages NONE 

the claims, Nos. NONE 

fx) the drawings, sheets/ftg NONE 



5. [^j This opinion has been drawn as if (some of) the amendments had not been made, since they have been considered to go 
beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)). 

* Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 are referred to 
in this opinion as "originally filed". 
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column 7, lines 40-61, column 17, line 64 through column 18, line 7; see also Figures 1 and 11. 
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WO 00/07323 PCT/US99/17369 



FORWARD ERROR CORRECTING SYSTEM WITH ENCODERS CONFIGURED IN PARALLEL AND/OR SERIES 

This non-provisional patent application claims the benefit under 35 U.S.C. Section 119(e) of United States 
Provisional Patent Application No, 60/094,629, filed on July 30,1 998, and Provisional Patent Application No, 60/098,394, filed 
on August 30,1998, and Provisional Patent Application No. 60/133,390, filed on May 10, 1999, all of which are incorporated 
herein by reference. 

Field of the Invention 

The present invention relates to the use of forward error correction techniques in data transmission over wired and 
wireless systems using an optional Reed-Solomon encoder as an outer encoder and a multiple concatenated convolutional 
encoder (in serial or parallel configuration) as an inner encoder. A preferred embodiment of the invention pertains particularly 
to ADSL systems, as a representative species of wired-based systems. 

Backfiround of the Invention 

The invention is based on use of a multiple concatenated convolutional encoder in serial or in parallel configuration. 
In the serial case it is called Serial Multiple Concatenated Convolutional Code (SMCCC), and in the parallel case is called 
Parallel Multiple Concatenated Convolutional Code (PMCCC). This gives an extra redundancy to the signal in a way that 
improves the performance of the codification (increasing the coding gain). 
Theory of Trellis Coding 

Modulation constellations of more than 2 points (such as Quadrature Amplitude Modulation (QAM), and Quaternary 
Phase Shift Keying (QPSK)) are used to increase the bit rate at the cost of smaller Euclidean distances (distance between 
adjacent points in a signal constellation). Coding techniques are used to decrease transmission errors, when transnutting over 
power-limited channels. 

Trellis Coding combines coding and modulation to improve bit error rate performance. As in other forms of forward 
error correction, the basic idea behind Trellis Coding is to introduce controlled redundancy in order to reduce channel error 
rates. What sets Trellis Codes apart is that this technique introduces redundancy by doubling the number of signal points in the 
QAM constellation (partitioning). BPSK and QPSK signal constellations are show in Figures 1 and 2. 

The actual (noisy) received signal will tend to be somewhere around the "correct" signal point. The receiver chooses 
the signal point closest to the noisy received signal. As more points are added to the signal constellation and the power is kept 
constant, the probability of error increases, because the Euclidean distance (distance between adjacent signal points) V is 
decreased and the receiver has a more difficult job making the correct decision. Thus it would make sense, that the Euclidean 
distance "</" dominates the probability of error expressions. 

Since the power is the same for both constellations, the required energy is also the same. The signal points in BPSK 
are d = 2 a pan and d = 1.414 apart for QPSK. 

The following expressions are for probability of error < for BPSK): 

Pe » - erfc 



_ 2 ^To . 



Substituting for "cf in die above: 



Pe ~ ~ erfc 



Pe « 4 er f° \ 



yfno 




(BPSK) 



(QPSK) 
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where erfc is the complementary error function. 

Trellis Coding expands on this concept to increase the Euclidean path distance for a more thorough derivation of the 
probability of error. With the exception of the constant factor in front of the complimentary error function, it should be noted 
that both error expressions depend on the signal spacing d and that the probability for QPSK errors is higher (not surprising 
since the signal spacing is smaller). Trellis coding enables us to recover from this increase in probability of error. 

M-QAM and PSK normally use a signal set of M=2k symbols in order to reduce the symbol rate by a factor of M. 
Examples of M=4 QAM and QPSK are show in Figures 3 and 4 respectively. 

Doubling the number of signal points in order to support two state Trellis Coding, we get the signal constellations for 
two state Trellis Coding shown in Figures 5 and 6. 

Thus, Trellis Coding uses 2*A/ possible symbols for the same factor-of-M reduction of bandwidth (and each signal is 
still transmitted during the same signaling period). 

Trellis Coding provides controlled redundancy, by doubling the number of signal points. In addition, Trellis coding 
defines the way in which signal transitions are allowed to occur. (Signal transitions that do not follow this scheme will be 
detected as errors). 

This is best explained using the Trellis Coded 8-PSK example. The 8-PSK signal constellation is show in Figure 7, 
where we can see the individual signal points. 

Note that the signal point labels H 0, 1,2,3 ,4,5,6,7" do not correspond to the actual data being sent. They are only 
convenient ways to label the signal points and keep from cluttering up the graphics. 

Without coding, the performance in 8-PSK depends on d 0 (d 0 =2 sin (71/8) =0. 765), which corresponds to a higher bit 
error rate than QPSK (d t =1.4Uy By using Trellis Coding, it is possible to improve the performance by restricting the way in 
which signals are allowed to transition. 

First the states of the trellis are defined. Lets label one state as "0426", and the other state as "1537". Each digit 
refers to one of four permitted signal points in the state (state points), with each state by itself representing a QPSK 
constellation, with each state's constellation being offset by 45 degrees from the other. 

Figure 8 describes a two-state trellis, 8-PSK system. If the system is in state "0426" only one of these four state 
points is used. If a n 0 M or "4 H is transmitted, the system remains in the same state. If however, a "2" or "6" is transmitted the 
system switches to the "1537" state. Now, only one of these four state points is used. If a "3" or "7" is transmitted, the system 
remains in this state, otherwise if a "1" or a H 5" is transmitted, it switches back to the "0426" state. Again, note that the system 
in each symbol represents two bits, so that when switching states, the m OPSK constellation is shifted by 45 degrees". 

Assuming that all input signals are equally likely, all signal paths are traced out over time. Just as we had for non- 
Trellis coding, the received signal includes noise and will tend to be located somewhere around the state points. The receiver 
again has to make a decision based on which signal point is closest and a mistaken output state value will be chosen if the 
receiver made an incorrect decision. 

In order to illustrate error events, lets assume that the transmitter is sending continuous "7" symbols. Figure 9 
illustrates the possible error events. In this case "S" followed by "6 W is received instead of the transmitted "7" - m T sequence. 
The Euclidean mean-squared distance for this path is the sum of the squares of the distance of each interval (see Figure 7 for an 
illustration of the Euclidean distances and Figure 8 for the Trellis Diagram): 



Jd 3 (7j) - d 2 (7.6) = Jd? + di = - (2 sin 



/. 608 



where d( 7.5) and d( 7,6) are the Euclidean distances between these two the signals "7" and *5 n , and "7" and "6" respectively. 

Figure 10 show when case "1" followed by "6" is received instead of the transmitted "7" - "7** sequence. The 
Euclidean distance (see Figure 7 for an illustration of the Euclidean distances 1 for this path: 
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Jd 3 (7.1) - d 2 (7.6) = yfjf^dl = ^2* [2**[j))' = 



/.<508 



Figure 1 1 show when case "5" followed by "2" is received instead of the transmitted "7" - "7" sequence. The 
Euclidean distance (see Figure 7 for an illustration of the Euclidean distances and Figure 8 for the Trellis Diagram) for this 
path is: 



Jd 2 (7.5) + d 3 (7,2) = J d j> * d I = ^2 + sin j^-J}" = 2.33 

Figure 12 show when case "1" followed by "2" is received instead of the transmitted "7" - "7" sequence. The 
Euclidean distance (see Figure 7 for an illustration of the Euclidean distances and Figure 8 for the Trellis Diagram) for this 
path is: 

4d 2 (7J) + d>(7.2) = 4df + di = ^2+ [2 sin = 233 

The only remaining error event is the single interval "3" instead of "7" error event, which has a Euclidean distance of 
2 (see Figure 7). 

Because of their large Euclidean distance (2.33), the H 5" - M 2" and "1" - "2" error events are least likely. The "1" - "6" 
and "5" - "6" error events are most likely because of their low Euclidean distance (1 .608). 

The minimum Euclidean distances for a trellis is the minimum free Euclidean distance *W £ " (similar to the minimum 
free distance in convolutional coding). For the above example d E = 1.608. 

Since d E is a measure of the closest spacing between adjacent state points (and therefore also more likely to cause 
errors), it dictates the lower bound for probability of error for the entire Trellis in the following way: 



Pe>a{d E )-erfc 



where, a (d E )is the number of error paths at distance d E . In the 2 states trellis example, there are 2 error paths at a distance of 
d E . Therefore the probability of error is: 

\£ 

I no 



J. 608 



P e £ erfc 

We found the probability of error for regular (non Trellis coded) QPSK to be: 

P e = erfc 



' L404 fif 1 
. 2 ino\ 



The improvement of two state Trellis Coding over QPSK is therefore 1 .608/ 1 .4 1 4 or 1 . 1 dB. 

This is a low coding gain for the amount of overhead required to handle Trellis coding. One might ask, is there a way 
to increase the coding gain obtainable with Trellis Coding? There certainly is. First, it is possible to increase the number of 
trellis states above 2, such as the four-state trellis shown in Figure 1 3. Note that the permitted state transitions are only drawn 
for column "I". The same state transitions are gain permitted in column "IT, "III", and so on. 

Increasing die number of states, one also increases the Euclidean distances. For example, in the above four state 
trellis coding case, all error events have a Euclidean distance of more than 2 (single "4" error). This single " 4* error, is the 
only "lowest" error event with minimum Euclidean path distance d E . 
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Therefore, the lower bound for 4 state Trellis Coding is: 




Comparing this equation to the equation for regular QPSK, we have a coding gain of 2:1 or 3 dB. 
Table 1 illustrates further coding gains that can be obtained by using even more states in the trellis: 
Table 1. Trellis Co ding Gain vs. Number of Trellis States 



# of Trellis States 


Coding Gain 


4 


3.54 


8 


4.01 


16 


4.44 


32 


5.13 


64 


5.33 


128 


5.33 


256 


5.51 



Another way to improve coding gain in Trellis Coding is to go to more than 2 dimensions. 

Summary of the Invention 

The present invention comprises forward error correction techniques in data transmission over wired systems using 
an optional Reed Solomon encoder as an outer encoder and a multiple concatenated convolutional encoder (MCCC) (in serial 
or parallel configuration) as an inner encoder. With an "optional" Reed-Solomon outer encoder we mean that it could be 
present or not. We describe its application to ADSL DMT (Discrete Multi-Tone, multiple-carrier) based systems. The 
extension to CAP/QAM (single-carrier) based, other xDSL systems (HDSL, VDSL, HDSL2, etc.), other wired communication 
systems, wireless systems and satellite systems is straightforward. 

ADSL modems are designed to operate between a Central Office CO (or a similar point of presence) and a customer 
premises CPE. As such they use existing telephone network wiring between the CO and the CPE. There are several modems 
in this class which function in generally similar manner. All of these modems transmit their signals usually above the votce 
band. As such, they are dependent on adequate frequency response above voice band. 

With the technique that we propose in this invention, it is possible to reach longer loops or reduce the transmitter 
power for ADSL systems. 

For wireless systems it is possible to reduce the power consumption, increase the coverage area and to extend the life 
of the portable systems. 

For satellite systems it is possible to increase the G/T factor around 4 dB, to increase the life of the satellite, to 
increase the coverage area and to reduce the requirements of the terrestrial systems. 

With the use of the Trellis Coded Modulation (TCM) it is possible to obtain coding gains between 3 and 6 dB 
(depending on the dimension of the trellis). Using the technique that we propose, the performance of this technique is within 1 
dB from the Shannon limit, at a bit error probability of 10' 7 . 

MCCC achieves near-Shannon-limit error correction performance. We have done some simulations that show bit 
error probabilities as low as 10* 5 at £^=0.6 dB. PMCCC yield very large coding gains (around 10 or 1 1 dB). hi the PMCCC 
case, after this value of 10\ the role of the interleaver is very critical and to avoid the floor-error it is necessary to make a 
good design of the interleaver. In our design the Reed-Solomon outer encoder help to take care of this floor-error lower than 

io- 7 
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In this invention, we present simulation results, and we compare the Reed-Solomon encoder (for R=8 and R=16) with 
the Trellis plus Reed-Solomon (T+R=8 and T+R=16) and the two PCCC plus Reed-Solomon (TC+R=8 and TC+R=16). In all 
this cases will not take into account the payload of the Reed-Solomon code, because will have the same effect in all coding 
techniques. 

5 These results, we present, are for Gaussian noise. In many wire-line systems, broadband impulse noise is also a 

significant transmission impairment. Although we have not modeled impulse noise effects in this analysis, in DMT systems, 
impulse noise whose duration is short compared to the frame size appears to be rather Gaussian-like, since it passes through a 
DFT in the receiver. Furthermore, because the noise is broadband, the noise energy in the signal band is distributed among the 
various frequency bins. Thus the additional immunity against additive white Gaussian noise provided by the trellis code should 
10 be beneficial for impulse noise as well. 

We present an encoder, decoders and some simulation results. 

Brief Des cription of the Several Views of the Drawings 
Figure 1 shows a BPSK signal constellation; 
Figure 2 shows a QPSK signal constellation; 
1 5 Figure 3 shows a QAM signal constellation with M=4; 

Figure 4 shows a QPSK signal constellation; 

Figure 5 shows a QAM signal constellation with M=8 (Used with two state Trellis); 

Figure 6 shows a PSK signal constellation with M=8 (Used with two state Trellis); 

Figure 7 shows a signal constellation with M=8 (Used with two state Trellis), 
20 Figure 8 shows a two-state Trellis 8-PSK system; 

Figure 9 shows an error Event "5" "6" in a 2 states Trellis encoding; 

Figure 10 shows an error Event "I" -» "6" in a 2 states Trellis encoding; 

Figure 1 1 shows an error Event "5" "2" in a 2 states Trellis encoding; 

Figure 12 shows an error Event "1 " "2" in a 2 states Trellis encoding; 
25 Figure 13 shows a four-state Trellis, 8-PSK system; 

Figure 14 shows a serial Concatenated (n^N) block code; 

Figure 15 shows the action of a uniform interleaver of length 4 on sequences of weight 2; 

Figure 16 shows a serially Concatenated (n,k,N) Convolutional code; 

Figure 17 shows a code sequence in Auj; 
30 Figure 1 8 shows an analytical bounds for SMCBC I for N = 4, 40, 400 and 4000; 

Figure 19 shows an analytical bounds for SMCBC2 for N = 5, 50, 500 and 5000; 

Figure 20 shows an analytical bounds for SMCBC3 for N = 7, 70, 700 and 7000; 

Figure 21 shows an analytical bounds for SMCCC 1 for N = 200, 400, 600, 800, 1000 and 2000; 

Figure 22 shows an analytical bounds for SMCCC2 for N=200, 400, 600, 800, 1000, 2000; 
35 Figure 23 shows an analytical bounds for SMCCC3 for N=200, 400, 600, 800, 1000, 2000; 

Figure 24 shows an analytical bounds for SMCCC4; 

Figure 25 shows a PMCCC; 

Figure 26 shows a transmission system structure; 

Figure 27 shows notations in a transmission system structure; 
^0 Figure 28 shows a PMCCC of three convolutional codes: 

Figure 29 shows a signal flow graph for extrinsic information; 

Figure 30 shows an iterative decoder structure for three parallel concatenated codes; 

Figure 31 shows an iterative decoder structure for two parallel concatenated codes: 
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Figure 32 shows a convergence of turbo coding: bit-error probability versus number of iterations for various Ei/No 
using the SW2-BCJR algorithm; 

Figure 33 shows a convergence of turbo coding: bit-error probability versus number of iterations for various Et/N 0 
using the SWAL2-BCJR algorithm; 

Figure 34 shows a bit-error probability as a function of the bit signal-to-noise ratio using the SW2-BCJR and 
SWAL2-BCJR algorithms with five iterations; 

Figure 35 shows a number of iterations to achieve several bit-error probabilities as a function of the bit 
signal-to-noise ratio using the S WAL2-BCJR algorithm; 

Figure 36 shows a Number of iterations to achieve several bit-error probabilities as a function of the bit 
signal-to-noise ratio using the SW2-BCJR algorithm; 

Figure 37 shows a basic structure for backward computation in the log-BCJR MAP algorithm; 

Figure 38 shows a Trellis Termination; 

Figure 39 shows an example where a block interleaver fails to "break" the input sequence; 
Figure 40 shows the two PMCCC performance, r = V*\ 
Figure 4 1 shows performance with short block sizes; 
Figure 42 shows three-code performance; 

Figure 43 shows a comparison of SMCBC and PMCBC with various interleaver lengths chosen so as to yield the 
same input decoding delay; 

Figure 44 shows a comparison of SMCCC and PMCCC with four-state MCCs; 

Figure 45 shows Block diagram of a parallel concatenated convolutional code (PMCCC) (a) a PMCCC rate =1/3 (b) 
iterative decoding of a PMCCC; 

Figure 46 shows Block diagram of a serial concatenated convolutional code (SMCCC) (a) an SMCCC rate =1/3 (b) 
iterative decoding of an SMCCC; 

Figure 47 shows a trellis encoder, 

Figure 48 shows an edge of the trellis section; 

Figure 49 shows the soft-input soft-output (SISO) model: 

Figure 50 shows the convergence of PMCCC-decoding: bit error probability versus the number of iterations using the 
AS W-SISO algorithm; 

Figure 51 shows the convergence of iterative decoding for a serial concatenated code: bit error rate probability versus 
number of iterations using the AS W-SISO algorithm; 

Figure 52 shows a comparison of two rate 1/3 PMCCC and SMCCC. The curves refer to six and nine iterations of the 
decoding algorithm and to an equal input decoding delay of 16,384: 

Figure 53 shows a block diagram for a modem transmitter in accordance with this invention, for the Central Office 
and for STM transport; 

Figure 54 shows a block diagram for a modem transmitter in accordance with this invention, for the Central Office 
and for ATM transport; 

Figure 55 shows a block diagram for a modem transmitter in accordance with this invention, for the Remote modem 
and for STM transport; 

Figure 56 shows a block diagram for a modem transmitter in accordance with this invention, for the Remote modem 
and for ATM transport; 

Figure 57 shows an ATU-C functional interfaces for STM transport at the V-C reference point: 
Figure 58 shows an ATU-C functional interfaces to the ATM layer at the V-C reference point; 
Figure 59 shows an ATM cell delineation state machine: 
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Figure 69 shows an Example implementation of the A 2 f measurement: 

Figure 61 shows an ADSL superframe structure - ATU-C transmitter. 

Figure 62 shows a fast synchronization byte ("fast byte") format - ATU-C transmitter. 

Figure 63 shows an interleaved synchronization byte ("sync byte") format - ATU-C transmitter, 

Figure 64 shows a fast data buffer - ATU-C transmitter, 

Figure 65 shows an interleaved data buffer, ATU-C transmitter, 

Figure 66 shows a scrambler, 

Figure 67 shows a tone ordering and bit extraction example (without trellis coding); 

Figure 68 shows a tone ordering and bit extraction example (with trellis coding); 

Figure 69 shows a conversion of u to v and W, 

Figure 70 shows a finite state machine for Wei's encoder, 

Figure 71 shows a convolutional Encoder, 

Figure 72 shows a trellis diagram; 

Figure 73 shows a constellation labels for b = 2 and b - 4; 

Figure 74 shows an expansion of point n into the next larger square constellation: 
Figure 75 shows a constellation labels for b = 3; 
Figure 76 shows a constellation labels for b - 5; 
Figure 77 shows a MTPR test; 

Figure 78 shows an ATU-R functional interfaces for STM transport at the T-R reference point; 

Figure 79 shows an ATU-R functional interfaces to the ATM layer at the T-R reference point; 

Figure 80 shows a fast data buffer - ATU-R transmitter, 

Figure 8 1 shows an interleaved data buffer - ATU-R transmitter, 

Figure 82 shows two parallel Concatenated convolutional Encoder, 

Figure 83 shows a conversion of u to v and w in the PMCCC encoder, 

Figure 84 shows a decoder for PMCCC; 

Figure 85 shows the convergence of "constellation" interleaver for PMCCC; 

Figure 86 shows an interleaver for PMCCC; 

Figure 87 shows a Serial Convolutional Concatenated Encoder, 

Figure 88 shows a decoder for SMCCC; 

Figure 89 shows an interleaver for SMCCC; 

Figure 90 shows the Convolutional Concatenated Encoder used for simulations; 

Figure 91 shows simulations for PMCCC; and, 

Figure 92 shows the Convolutional encoder uses for simulations. 

Detailed Description of the Preferred Embodiment 
We hereby incorporate by reference the following references: 

1 . Rauschmayer, Dennis J. "ADSL/VDSL Principles", Macmillan Technical Publishing, 1 999. 

2. ITU G.992. 1 "ADSL Transceivers", ITU, 1999. 

3. ITU 1.432 "B-ISDN user-network interface-physical layer specification", ITU , 1993. 

4. Benedetto, Divsalar, Montorsi and F. Pollara, "'Serial Concatenation of Interleaved Codes: Performance Analysis, 
Design, and Iterative Decoding", The Telecommunications and Data Acquisition Progress Report 42-126, Jet 
Propulsion Laboratory, Pasadena, California, pp. 1-26, August 15, 1996. 



WO 00/07323 




PCT/US99/17369 



5. Benedetto, Divsaiar, Montorsi and F. Pollara, ; A Soft-Output Maximum A Posteriori (MAP) Module to decode 
parallel and Serial Concatenated Codes", The Telecommunications and Data Acquisition Progress Report 42-127, Jet 
Propulsion Laboratory, Pasadena, California, pp. 1-20, November 15, 1996. 

6. L. R. Bahl, J. Cocke, F. Jelinek, and J. Raviv, 'Optimal Decoding of Linear Codes for Minimizing Symbol Error 
Rate," IEEE Transactions on Information Theory, pp. 284-287, March 1974. 

7. Divsaiar and F. Pollara, Turbo Codes for PCS Applications", Proceedings of ICC95, Seattle, Washington, pp. 54-59, 
June 1995. 

8. D. Divsaiar and F. Pollara, Multiple Turbo Codes**, Proceedings of IEEE MILCOM95, San Diego, California, 
November 5-8, 1995. 

9. D. Divsaiar and F. Pollara, "Soft-Output Decoding Algorithms in iterative Decoding of Turbo Codes," The 
Telecommunications and Data Acquisition Progress Report 42-124, Jet Propulsion Laboratory, Pasadena, California, 
pp. 63-87, February 15, 1995. 

1 Performance Analysis, design and iterative decoding of SMCCC and PMCCC. 
1 1 Analytical Bounds to the Performance of Serially Multiple Concatenated Codes. 
I.I.I. Serially Multiple Concatenated Block Codes ( SMCBC) 

The scheme of two serially concatenated block codes is shown in Figure 14. It is composed of two cascaded CCs, the 
outer (N.k) code C 0 with rate P° c = and the inner (n, N) code C, with rate R c = N/n, linked by an interleaver of length N. 
The overall SMCBC is then an (n, k) code, and we will refer to it as the (n, k, N) code C s , including also the interleaver length. 
In the following, we will derive an upper bound to the ML performance of the overall code C s . We assume that the CCs are 
linear, so that the SMCBC also is linear and the uniform error property applies, i.e., the bit-error probability can be evaluated 
assuming that the all-zero codeword has been transmitted. 

A crucial step in the analysis comprises of replacing the actual interleaver that performs a permutation of the N input 
bits with an abstract interleaver called "uniform interleaver". This abstract interleaver is defined as a probabilistic device that 

maps a given input word of weight / into all distinct permutations of it, with equal probability p (see Figure 15). The 

output-word of the outer code and the input word of the inner code share the same weight. Use of the uniform interleaver 
permits the computation of the "average" performance of SMCBCs, intended as the expectation of the performance of 
SMCBCs using the same MCCs, taken over the ensemble of all interleaves of a given length. It can be proof the 
meaningfulness of the average performance, in the sense that there will always be, for each value of the signal-to-noise ratio, at 
least one particular interleaver yielding performance better than or equal to those of the uniform interleaver. 
Let us define the input-output weight enumerating function (IOWEF) of the SMCBC Cs as 



where A C W ' M is the number of codewords of the SMCBC with weight /* associated with an input word of weight w. We also 

define the conditional weight enumerating function (CWEF) A c '(w>H) of the SMCBC as the weight distribution of 
codewords of the SMCBC that have input word weight h\ It is related to the IOWEF by 



With knowledge of the CWEF, an upper bound to the bit-error probability of the SMCBC can be obtained in the form 



A C '(WM) = ZA% h W w H h (1) 



w.h 





(3) 
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where R c = k/n is the rate of Cs , and Et SN 0 is the signal-to-noise ratio per bit. 

The problem comprises in the evaluation of the CWEF of the SMCBC from the knowledge of the CWEFs of the outer 
and inner codes, which we call A c °(w.L) and A Cl fl*H) . To do this, we exploit the properties of the uniform interleave. 

which transforms a codeword of weight / at the output of the outer encoder into all its distinct permutations. As a 

consequence, each codeword of the outer code C c of weight /, through the action of the uniform interleave^ enters the inner 

encoder generating |^ J codewords of the inner code C Thus, the number A%% of codewords of the SMCBC of weight h 

associated with an input word of weight w is given by 

AC % - i (4) 

1=0 



From Equation (4), we derive the expressions of the IOWEF and CWEF of the SMCBC: 

1=0 



0 



n A c ' (W.Dx A c 'flM) 
A C *(W,H) = Z 7-t (6) 

1=0 



0 



where A Co 0^J) is the conditional weight distribution of the input words that generate codewords of the outer code of weight 
/. 

1 .1.2. Serially Multiple Concatenated Convolutional Codes 

The structure of a serially multiple concatenated convolutional code (SMCCC) is shown in Figure 16. It refers to the 
case of two convolutional CCs, with the outer code Co with rate R° c = k/p t and the inner code C, with rate R* c = p/n, joined by 
an interleave of length A ; bits. In this way they generating an SMCCC Cs with rate R c = k/n. Note that N must be an integer 
multiple of p. We assume, as before, that the convolutional CCs is linear, so that the SMCCC is linear as well, and the 
uniform error property applies. The exact analysis requires the use of a hypertrellis having as hyperstates pairs of states of outer 
and inner codes. The hyperstates S SJ and S i m are joined by a hyperbranch that comprises of all pairs of paths with length N/p 
that join states Si and si of the inner code and states sj and s m of the outer code, respectively. Each hyperbranch is thus an 
equivalent SMCBC labeled with an IOWEF that can be evaluated as explained in the previous subsection. From the 
hypertrellis, the upper bound to the bit-error probability can be obtained through the standard transfer function technique 
employed for convolutional codes. 
1 .2. Design of Serially Multiple Concatenated Codes 

For practical applications, SMCCCs are to be preferred to SMCBCs. One reason is that maximum a posteriori 
algorithms are less complex for convolutional than for block codes; a second is that the interleaver gain can be greater for 
convolutional CCs, provided they are suitably designed. Hence, we deal mainly with the design of SMCCCs, extending our 
conclusions to SMCBCs when appropriate. 

Consider the SMCCC depicted in Figure 16. Its performance can be approximated by that of an equivalent block code 
whose IOWEF labels the branch of the hypertrellis joining the zero states of the outer and inner codes. Denoting by 
A Cs (w, //) the CWEF of this equivalent block code, we can rewrite the upper bound, Equation (3), as (subscript m will 
denote minimum, and a subscript A/ will denote maximum) 
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Nvhere is ^ minimum weight of an input sequence generating an error event of the outer code, and h„ is the minimum 
weight (since the input sequences of the inner code are not unconstrained independent identically distributed (i.i.d) binary 
sequences but, instead, codewords of the outer code, h m can be greater than the inner code free distance, d f ) of the codewords 
of C s . By "error event of a convoiutional code" we mean a sequence diverging from the zero state at time zero and remerging 
into the zero state at some discrete time; > 0. For constituent block codes, an error event is simply a codeword. 

The coefficients A»% of the equivalent block code can be obtained from Equation (4) once the quantities A$ 0 t and 
Aik of the CCs are known. To evaluate them, consider a rate R=p/n convoiutional code C with memory k and its equivalent 
(N/R . N - pv) block code whose codewords are all sequences of length N/R bits of the convoiutional code starting from and 
ending at the zero state. By definition, the codewords of the equivalent block code are concatenations of error events of the 
convoiutional codes. Let 

A(LHJ) - Z AiKj H h (11) 
h 

be the weight enumerating function of sequences of the convoiutional code that concatenate j error events with total input 
weight / (see Figure 1 7), where A i,hj is the number of sequences of weight h, input weight /, and number of concatenated error 
events/ For N much larger than the memory of the convoiutional code, the coefficient Af h of the equivalent block code can be 
approximated (this assumption permits neglecting the length of error events compared to N , which also assumes that the 

number of ways/ input sequences producing; error events can be arranged in a register of length N is 



P 
^ jJ 



The ratio N/p 



derives from the fact that the code has rate p/n, and thus N bits corresponds to N/p input words or, equivalently, trellis steps) by 



A c wJ - 



z 



p 



Apkj 



(12) 



where n M , the largest number of error events concatenated in a codeword of weight /; and generated by a weight / input 
sequence, is a function of h and / that depends on the encoder. Let us return now to the block code equivalent to the SMCCC. 
Using the previous result of Equation (12) with j = «' for the inner code, and the analogous one, j=n° , for the outer code 
(superscripts o and / will refer to quantities rjertaining to outer and inner code, respectively), 
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(13) 



and substituting them into Equation (4), we obtain the coefficient of the serially concatenated block code equivalent to 

the SMCCC in the form 
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where <f f is the free distance of the outer code. By free distance d f we mean the minimum Hamming weight of error events for 
convolutional CCs and the minimum Hanuning weight of codewords for block CCs. We are interested in large interleaver 
lengths and thus use for the binomial coefficient the asymptotic approximation 

{ N \ ~ 221 

Substitution of this approximation in Equation (14) yields 



A c w % - Z Z Z 



(15) 



/iW o tit" wXn° w £W 

Finally, substituting Equation ( 1 5) into Equation ( 1 0) gives the bit-error probability bound in the form 



Pb(e)^ 



If 



Z Z Z Z N^^—rj 



W n 

— A° A 1 



(16) 



Using Expression (16) as the starting point, we will obtain some important design considerations. The bound, 
Expression (16), to the bit-error probability is obtained by adding terms of the first summation with respect to the SMCCC 
weights h. The coefficients of the exponential in h depend, among other parameters, on M For large N , and for a given h, the 
dominant coefficient of the exponential in h is the one for which the exponent of N is maximum. Define this maximum 
exponent as 

a(h) = max { n° + ri ' - I - / } (17) 

Evaluating afli) in general is not possible without specifying the CCs. Thus, we will consider two important cases for 
which general expressions can be found. 
1 .2. 1 . The Exponent of N for the Minimum Weight 

For large values of EtfNo , the performance of the SMCCC is dominated by the first term of the summation in A, 

corresponding to the minimum value h — h m . Remembering that, by definition, n x M and „° M are the maximum number of 

concatenated error events in codewords of the inner and outer code of weights h m and /, respectively, the following inequalities 
hold true: 



nit ^ 



I 



(18) 



(19) 



and 



a(hm) ^ max 







/ 


.,.,). 






im( h m ) 












I d °f J 



Uihn) - 1 (20) 



where /„ (h m ) is the minimum weight / of codewords of the outer code yielding a codeword of weight h m of the inner code, and 
Z-cVmeans 'integer part of x"(floor value) In most cases, l m (h n ) < 2d} and h m < 2rfy,sothat „* u =>n° M = 1 and 
Equation (20) becomes 

a(hj = 1 - l m (h m ) < 1 - d° f (21) 
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The result, Equation (2 1 ), shows that the exponent of N corresponding to the minimum weight of SMCCC codewords 
is always negative for 2 £ d° f , thus yielding an interleaver gain at high Ei/N 0 . Substitution of the exponent a (hj into 
Expression (16) truncated to the first term of the summation in h yields 

lim P b (e)_ 5 Bm N 1 "* e^*^ 4 ) (22) 



It. 



where the constant B m is 



Bm 1Z 2 ™ A WtlmXhm)J 

K P w€W m 

and W m is the set of input weights w that generates codewords of the outer code with weight l m (h m ). Expression (22) suggests 
the following conclusions: 

1 . For the values of Et/N 0 and N where the SMCCC performance is dominated by its free distance df* = h„ , increasing 
the interleaver length yields a gain in performance. 

2. To increase the interleaver gain, one should choose an outer code with a large d°f . 

3. To improve the performance with Et/No* one should choose an inner and outer code combination such that h„ is large. 
These conclusions do not depend on the structure of the CCs, and thus they apply for both recursive and nonrecursive 

encoders. 

However, for a given Et/No* there seems to be a minimum value of AT that forces the bound to diverge. In other words, 
there seem to be coefficients of the exponents in h t for h > h „, that increase with N . To investigate this phenomenon, we will 
evaluate the largest exponent of//, defined as 

clm = max{ a(h) } - max{ n ° + »'-/-/ } (23) 

This exponent will permit one to find the dominant contribution to the bit-error probability for N—toa 
1 .2.2. The Maximum Exponent of N 

We need to treat the cases of nonrecursive and recursive inner encoders separately. As we will see, nonrecursive 
encoders and block encoders show the same behavior. 
1 .2.2. 1 Block and Nonrecursive Convolutional Inner Encoders. 

Consider the inner code and its impact on the exponent of N in Equation (23). For a nonrecursive inner encoder, we 
have fi'm ^ ' ■ In fact, every input sequence with weight J generates a finite-weight error event, so that an input sequence with 
weight / will generate, at most, / error events corresponding to the concatenation of / error events of input weight /. Since the 
uniform interleaver generates all possible permutations of its input sequences, this event will certainly occur. Thus, from 
Equation (23) we have 

a M = n° M - J * 0 

and interleaving gain is not allowed. This conclusion holds true for both SMCCC employing a nonrecursive inner encoder and 
for all SMCBCs, since block codes have codewords corresponding to input words with weight equal to 1. For those SMCCCs, 
we always have, for some /*, coefficients of the exponential in h of Expression (16) that increase with N y and this explains the 
divergence of the bound arising, for each Eh 'T^o, when the coefficients increasing with S become dominant. 
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1.2.2.2. Recursive Inner Encoders. 

For recursive convolution^ encoders, the minimum weight of input sequences generating error events is 2. As a 

consequence, an input sequence of weight / can generate at most error events. 

Assuming that the inner encoder of the SMCCC is recursive, the maximum exponent of AT in Equation (23) becomes 

a M - m«{rf, + |jJ-/-/}= n^j^.^J.,} (24) 

The rnaxirnizauon involves / and w, since n° M depends on both quantities. In fact, remembering the definition of 
n° u as the maximum number of concatenated error events of codewords of the outer code with weight / generated by input 
words of weight w, it is straightforward, as in Equation ( 1 9), to obtain 

/ 



(25) 



Substituting now the last inequality, Equation (25), into Equation (24) yields 

/ 



max 



V d °f 



(26) 



To perform the maximization of the right-hand side (RHS) of Expression (26), consider first the case of 
where q is an integer, so that 



ccm ^ max 

9 





qd° f + l 




q - 


2 


• 1 



(27) 



The RHS of Expression (27) is maximized, for 2 < d° f , by choosing q = /. On the other hand, for 

qd° f < I < (q + Ud° f 

the most favorable case is / = qd°y , which leads us again to the previously discussed situation. Thus, the niaximization 
requires / = d° f - For this value, on the other hand, we have, from Equation (25), n ° M < /, and the inequality becomes an 
equality if weW fy where W f is the set of input weights w that generates codewords of the outer code with weight / = d° f . In 



conclusion, the largest exponent of n is given by 



(28) 



The value of om in Equation (28) shows that the exponents of .V in Expression (16) are always negative integers. 
Thus, for all //, the coefficients of the exponents in h decrease with N , and we always have an mterleaver gain. Denoting by 
df.ejf me minimum weight of codewords of the inner code generated by weight-2 input sequences, we obtain a different 

weight U(qm> for even and odd values of d° f . For even d° f , the weight h(md associated to the highest exponent of N is given 
by 

h(aK{) . <!1£ml 
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Since it is the weight of an inner codeword that concatenates d°f tl error events with weight d^^ff . Substituting the 
exponent ocm into Expression (16), approximated by only the term of the summation in h corresponding to h=h(aM), yields 

Pb(e) - < Beven NT e'{ j (29a) 



lim 



where 



dV 



* PT (-f)l 



(29b) 



In Equation (29b), w^/is the maximum input weight yielding outer codewords with weight equal to d°f » and N° f is 
the number of such codewords. 

For d°f odd, the value ofhfa^ is given by 



h(a M ) = 



(30) 



where hfm is the minimum weight of sequences of the inner code generated by a weight-3 input sequence. In this case, in fact, 
d °f ' 1 

we have n M = concatenated error events, of which n ' M - / are generated by weight-2 input sequences and one is 

generated by a weight-3 input sequence. 

Thus, substituting the exponent om into Expression (16) approximated by keeping only the term of the summation in 
h corresponding to h = h(aju) yields 

Hm P b (e) ~^ Bodd N~~^T~ . -(P^ * " ]* *) (3I ) 



where 



Bodd 



d° f ! 



k p- 



(d° f -3) 



Z v A 



dV 



dyi 
k p 2 



(d}-3) 



(32) 



In cases of d° f both even and odd, we can draw from Expressions (29) and (3 1 ) a few important design considerations, as 
follows: 

(1) In contrast with the case of block codes and nonrecursive convolutional inner encoders, the use of a recursive 
convolutional inner encoder always yields an interleaver gain. As a consequence, the first design rule states that the 
inner encoder must be a convolutional recursive encoder. 

(2) The coefficient h(OM) that multiplies the signal-to-noise ratio Et/N 0 in Expression (16) increases for increasing values 
of d'/fff • Thus, we deduce that the effective free distance of the inner code must be maximized. Both this and the 
previous design rule also had been stated for PMCCCs. As a consequence, the recursive convolutional encoders 
optimized for use in PMCCCs can be employed altogether as inner CC in SMCCCs. When d° f is odd, for special 
cases it is possible to increase Ii(om) and h m further by choosing the feedback polynomial of the inner code to have a 
factor (1 yielding hm } = Note that there are other feedback polynomials such as(/+D + D ? + D J + D v ;or 
(1 + D + EST + D 3 * D 4 + D s - D 6 ) yielding tf*> = ca 
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(3) The interleaver gain is equal to N™ for even values of d°f and to M — T~ for odd values of d°f As a 

consequence, we should choose, compatibly with the desired rate Re of the SMCCC, an outer code with a large and, 
possibly, an odd value of the free distance. 

(4) As to other outer code parameters, N° f and w M/ should be niinimized. In other words, we should have the minimum 
number of input sequences generating free distance error events of the outer code, and their input weights should be 
minimized. Since nonrecursive encoders have error events with w = J and, in general, less input errors associated 
with error events at free distance, it can be convenient to choose as an outer code a nonrecursive encoder with 
minimum N°f and w M /. 

1 .2.2.3. Examples Confirming the Design Rules 

To confirm the design rules obtained asymptotically,(i.e., for large signal-to-noise ratios and large interleaver lengths 
N) we evaluate the upper bound, Expression (16), to the bit-error probability for several block and convolutional SMCCs with 
different interleaver lengths, and compare their performances with those predicted by the design guidelines. 
1.2.2.3.1. Serially Multiple Concatenated Block Codes. 

We consider three different SMCBCs obtained as follows: 

a) The first is the (7m. 3m. N) SMCBC; 

b) The second is a (15m. 4m, N) SMCBC using as outer code a (5. 4) parity-check code and as inner code a (15. 5) 
Bose-Chaudhuri-Hocquenghem (BCH) code; 

c) The third is a (15m. 4m, N) SMCBC using as outer code a (7, 4) Hamming code and as inner code a (15, 7) BCH 

code. 

Note that the second and third SMCBCs have the same rate, 4/15. The outer, inner, and SMCBC code parameters 
introduced in the design analysis are listed in Table 2. 

In Figures 18, 1 9 and 20, we plot the bit-error probability bounds for SMCBCs l,2and3 ofTable2. Code SMCBC1 
has d°/ = 2\ thus, from Equation (21 ), we expect an interleaver gain going as N-L This is confirmed by the curves of Figure 18, 
which, for a fixed and sufficiently large signal-to-noise ratio, show a decrease in P b (e) of a factor of 10 when N passes from 4 
to 40, from 40 to 400, and from 400 to 4000. Moreover, from Expression (22), we expect, in each curve for In P b (e), a slope 
with Et/No as -hjt e . From Table 2, we know that R c =3/7, -h m = J, so that P b (e) should decrease by a factor of e hmR c =3. 6 
when the signal-to-noise ratio increases by 1 (not in dB). This behavior fully agrees with the curves of Figure 18. Finally, the 
curves of Figure 18 show a divergence of the bound at lower Ei/N 0 for increasing N. This is due to coefficients of terms with // 
> h m in Expression (16) that increase with N and whose influence becomes more important for larger N. 



Table 2. Design param eters of CCs and SMCBCs for three serially concatenated block codes. 

Outer code Inner code SMCBC 



Code 


Code type 




d° f 


Code type 




Dif 


diteff 


hm 


Odin,) 


SMCBC 1 


Parity check (4,3) 


1 


2 


Hamming (7,4) 


1 


3 


3 


3 


-1 


SMCBC2 


Parity check (5,4) 


1 


2 


BCH (15,5) 


1 


7 


7 


7 


-1 


SMCBC 3 


Hanuning (7,4) 


1 


3 


BCH (15,7) 


1 


5 


5 


5 


-2 



Code SMCBC2 hasd°/= 2\ thus, from Equation (2 1 ), we expect the same interleaver gain as for SMCBC1 , i.e., A' 
This is confirmed by the curves of Figure 19. This code, however, has a larger minimum distance h m = 7, and a rate R e =4/15. 
Thus, we expect a steeper descent of P b (e) with Et/hlo. More precisely, we expect a decrease by a factor of 6.5 when the 
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signal-to-noise ratio increases by /. This, too, is confirmed by the curves, which also show the bound divergence predicted in 
our analysis. 

Code SMCBC3 has = 3\ thus, from Equation (21), we expect a larger interleaver gain than for SMCBC1 and 
SMCBC2, i.e., N - 2. This is confirmed by the curves of Figure 20. which, for a fixed and sufficiently large signal-to-noise 
ratio, show a decrease in P b (e) of a factor of 100 when N passes from 7 to 70 T from 70 to 700, and from 700 to 7000. This code 
has a nunimum distance h m =5 and a rate R c =4/1 5, which means a descent of P b (e) with Et/N 0 by a factor of 3.8 when the 
signal-to-noise ratio increases by 1. This, too, is confirmed by the curves. As to the bound divergence, we notice a slightly 
different behavior with respect to previous cases. The curve with N = 7000, in fact, denotes a strong influence of coefficients 
increasing with N for Et/N 0 lower than 7. 
1.2.2.3.2 . Serially Multiple Concatenated Convolutional Codes. 

We consider four different SMCCCs obtained as follows: The first, SMCCC1, is a (3.1.N) SMCCC, using as outer 
code a four-state (2,1) recursive, systematic convolutional encoder and as inner code a four-state (3,2) recursive, systematic 
convolutional encoder. The second, SMCCC2, is a (3,1 J*) SMCCC, using as outer code the same four-state (2,1) recursive, 
systematic convolutional encoder as SMCCC 1, and as inner code a four-state (3,2) nonrecursive convolutional encoder. The 
third, SMCCC3, is a (3,1,N) SMCCC, using as outer code a four-state (2,1) nonrecursive, convolutional encoder, and as inner 
code the same four-state (3,2) recursive, systematic convolutional encoder as SMCCC I. Finally, the fourth, SMCCC4, is a 
(6,2,N) SMCCC using as outer code a four-state (3,2) nonrecursive convolutional encoder, and as inner code a four-state (6,3) 
recursive, systematic convolutional encoder obtained by using three times the four-state (2,1) recursive, systematic 
convolutional encoders in Table 2. 

The outer, inner, and SMCCC code parameters introduced in the design analysis are listed in Table 3. In this table, 
the CCs are identified through the descriptions of Table 2. In Figures 21, 22, 23, and 24, we plot the bit-error probability 
bounds for SMCCCs 1,2,3, and 4 of Table 3, with input information block lengths F? C N = 1 00. 200, 300, 400, 500, and 1000. 

Consider first the SMCCCs employing as inner CCs recursive, convolutional encoders. They are SMCCC 1, 
SMCCC3, and SMCCC4. Code SMCCC1 has d°/= 5; thus, from Expression (31), we expect an interleaver gain behaving as N 
- 3. This is fully confirmed by the curves of Figure 21, which, for a fixed and sufficiently large signal-to-noise ratio, show a 
decrease in Ptfe) of a factor of 1000 when N passes from 200 to 2000. For an even more accurate confirmation, one can 
compare the interleaver gain for every pair of curves in the Figure 21. Moreover, from Expression (31), we expect in each 
curve for In P b (e) a slope with Et/No as -hfctM)!^ . From Table 3, we know that R c =l/3 and h(oM ;=7,so that P b (e) should 
decrease by a factor of 10.3 when the signal-to-noise ratio increases by /. This behavior fully agrees with the curves of Figure 
2 1 , Finally, the curves of Figure 2 1 do not show a divergence of the bound at lower Et/No for increasing N. This is due to the 
choice of a recursive encoder for the inner code, which guarantees that all coefficients ofli) decrease with N. 

Table 3. Design paramet ers of MCCs and SMCCCs for four SMCCCs. Outer code Inner code SMCCC 



Code 



Code type 



w° ffl 



Code type 



4r 



hm 



CtOlm) 



h(a M ) 



SMCCC 
1 



Rate 1/2 recursive 



Rate 2/3 recursive 



SMCCC 
2 



Rate 1/2 recursive 



Rate 2/3 
nonrecursive 



SMCCC 
3 



Rate 1/2 
nonrecursive 



Rate 2/3 recursive 



-3 



SMCCC 
4 



Rate 2/3 
nonrecursive 



Rate 1/2 recursive 
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Code SMCCC3 differs from SMCCC1 only in the choice of a nonrecursive outer encoder, which is a four-state 
encoder (see Tables 2 and 3) with the same <f/as for SMCCC 1, but with W m = J instead of w° m = 2. 

From the design conclusions, we expect a slightly better behavior from this SMCGC. This is confirmed by the 
performance curves of Figure 23, which present the same interleaver gain and slope as those of SMCCC1 but have a slightly 
5 lower P b (e) (the curves for SMCCC3 are translated versions of those of SMCCC 1 by 0. 1 dB). 

Code SMCCC4 employs the same CCs as SMCCC2 but reverses their order. It uses as outer code a rate 2/3 
nonrecursive cbnvolutional encoder, and as inner code, a rate 1/2 recursive convolutional encoder. As a consequence, it has a 
lower <f f = 3 and a higher om = - 2. Thus, from Expression (31), we expect a lower interleaver gain than for SMCCC 1 and 
SMCCC 3 as N - 2. This is confirmed by the curves of Figure 24, which, for a fixed and sufficiently large signal-to-noise ratio, 
1 0 show a decrease in P b (e) of a factor of 100 when N passes from 150 to 1500. As to the slope with Et/N 0 , this code has the same 
-h(cK)R c as SMCCC1 and SMCCC3 and, thus, the same slope. On the whole, SMCCC4 loses more than 2 dB in coding gain 
with respect to SMCCC3. This result confirms the design rule suggesting the choice of an outer code with d° f as large as 
possible. 

Finally, let us consider code SMCCC2, which differs from SMCCC 1 in the choice of a nonrecursive inner encoder, 
1 5 with the same parameters but with the crucial difference of W m = /. Its bit-error probability curves are shown in Figure 22. We 
see, in fact, that for low signal-to-noise ratios, say below 3, no interleaver gain is obtained. This is because the performance is 
dominated by the exponent h(ctM ), whose coefficient increases with N . On the other hand, for larger signal-to-noise ratios, 
where the doniinant contribution to P b (e) is the exponent with the lowest value of h m , the interleaver gain makes its 
appearance. From Expression (22), we foresee a gain as N - 4, meaning four orders of magnitude for N passing from 100 to 
20 1000. Curves in Figure 22 show a smaller gain (slightly higher than 1/1000), which is, on the other hand, rapidly increasing 
with Et/No- 

1.3. Parallel Multiple Concatenated Convolutional Codes 

The concept of Parallel Multiple Concatenated Convolutional Code (PMCCC) utilizes a soft-output decoding and an 
iterative decoding. We present two versions of a simplified maximum a posteriori (MAP) decoding algorithm. The algorithms 
25 work in a sliding window form (like the Viterbi algorithm) and can thus be used to decode continuously transmitted sequences 
obtained by PMCCC, without requiring code trellis termination. A heuristic explanation is also given of how to embed the 
maximum a posteriori algorithms into the iterative decoding of PMCCC. The performances of the two algorithms are compared 
on the basis of a powerful rate 1/3 PMCCC. Basic circuits to implement the simplified a posteriori decoding algorithm using 
lookup tables, and two further approximations (linear and threshold), with a very small penalty, to eliminate the need for 
30 lookup tables are proposed. 

The broad framework of this analysis encompasses digital transmission systems where the received signal is a 
sequence of waveforms whose correlation extends well beyond T, the signaling period. There can be many reasons for this 
correlation, such as coding, intersymbol interference (ISI), or correlated fading. The optimum receiver in such situations cannot 
perform its decisions on a symbol-by-symbol basis, so that deciding on a particular information symbol u k involves processing a 
35 portion of the received signal T d seconds long, with T d >T. The decision rule can be either optimum with respect to a sequence 
of symbols, u \ = ( ut *Uk+t>-->Uk+ n -i) , or with respect to the individual symbol, m . 

The most widely applied algorithm for the first kind of decision rule is the Viterbi algorithm. In its optimum 
formulation, it would require waiting for decisions until the whole sequence have been received. In practical implementations, 
this drawback is overcome by anticipating decisions (single or in batches) on a regular basis with a fixed delay, D. Choice of D 
as five to six times the memory of the received data is widely recognized as a good compromise between performance, 
complexity, and decision delay. 
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Optimum symbol decision algorithms must base their decisions on the maximum a posteriori (MAP) probability. 
They have been known since the early seventies, although much less popular than the Viterbi algorithm and almost never 
applied in practical systems. There is a very good reason for this neglect in that they yield performance in terms of symbol error 
probability only slightly superior to the Viterbi algorithm, yet they present a much higher conceptual complexity. Only recently, 
the interest in these algorithms has seen a revival in connection with the problem of decoding concatenated coding schemes. 
Concatenated coding schemes (a class in which we include product codes, multilevel codes, generalized concatenated codes, 
and serial and parallel concatenated codes) were proposed as a means of achieving large coding gains by combining two or 
more relatively simple "constituent" codes. The resulting concatenated coding scheme is a powerful code endowed with a 
structure that permits an easy decoding, like "stage decoding" or "iterated stage decoding". 

To work properly, all these decoding algorithms cannot limit themselves to passing the symbols decoded by the inner 
decoder to the outer decoder. Thev need to exchange s ome kind of soft information . The optimum output of the inner decoder 
should be in the form of the sequence of the probability distributions over the inner code alphabet conditioned on the received 
signal, the a posteriori probability (APP) distribution. There have been several attempts to achieve, or at least to approach, this 
goal. Some of them are based on modifications of the Viterbi algorithm so as to obtain, at the decoder output, in addition to the 
"hard"-decoded symbols, some reliability information. This has led to the concept of "augmented-output~ or the list^ecoding 
Viterbi algorithm, and to the soft-output Viterbi algorithm (SOVA). These solutions are clearly sub-optimal, as they are unable 
to supply the required APP. A different approach consisted in revisiting the original symbol MAP decoding algorithms with the 
aim of simplifying them to a form suitable for implementation. Figure 25 shows a PMCCC whose encoder is formed by two (or 
more) constituent systematic encoders joined through an interleaves The input information bits feed the first encoder and, after 
having been interleaved by the interleaver, enter the second encoder. The codeword of the PMCCC comprises of the input bits 
to the first encoder followed by the parity check bits of both encoders. Generalizations to more than one interleaver are possible 
and fruitful. 

The sub-optimal iterative decoder is modular and comprises of a number of equal component blocks formed by 
concatenating soft decoders of the constituent codes (CC) separated by the interleaves used at the encoder side. By increasing 
the number of decoding modules and, thus, the number of decoding iterations, bit-error probabilities as low as 10' 5 at E^ 0 
=0.0 dB for rate 1/4 PMCCC have been shown by simulation. 

We will describe two versions of a simplified MAP decoding algorithm that can be used as building blocks of the 
iterative decoder to decode PMCCCs. A distinctive feature of the algorithms is that they work in a "sliding window" form, like 
the Viterbi algorithm, and thus can be used to decode "continuously transmitted" PMCCCs, without requiring trellis 
termination and a block-equivalent structure of the code. 

The final aim is to find suitable soft-output decoding algorithms for iterated staged decoding of PMCCC employed in 
a continuous transmission. 

We will refer to the transmission system of Figure 26. The information sequence w, composed of symbols drawn from 

an alphabet U={ uj u Kf } and emitted by the source, enter an encoder that generates code sequences c. Both source and code 

sequences are defined over a time index set K (a finite or infinite set of integers). Denoting the code alphabet C=f Cj c M } , 

the code C can be written as a subset of the Cartesian product of C by itself /f times, i.e., C cC K . The code symbols c k (the 
index k will refer to time) enter the modulator, which performs a one-to-one mapping of them with its signals, or channel input 
symbols x k , belonging to the set A'=£r/ x M }. 

The channel symbols jr^are transmitted over a stationary memoryless channel with output symbols y k . The channel is 
characterized by the transitions probability distribution (discrete or continuous, according to the channel model) P Cv\x). The 
channel output sequence is fed to the symbol-by-symbol soft-output demodulator, which produces a sequence of probability 
distributions yu (cj over C conditioned on the received signal, according to the memoryless transformation. 
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Y k (c) = P(x k = x(c),y t ) = Pf^ix* = x(c)) p k (c) = ^ (x) (33) 

where we have assumed to know the sequence of the a priori probability distributions of the channel input symbols (P k 
(x):keK) and made use of the one-to-one mapping C X. 

The sequence of probability distributions y k (c) obtained by the modulator on a symbol-by-symbol basis is then 
supplied to the soft-output symbol decoder, which processes the distributions in order to obtain the probability distributions P * 
(u\ y). They are defined as 

P k (u\y) = P( Uk = u \y) (34) 

The probability distributions P tfu\ y) are referred to in the literature as symbol-by-symbol a posteriori probabilities 
(APP) and represent the optimum symbol-by-symbol soft output. 

From here on, we will limit ourselves to the case of time-invariant convolutional codes with N states, use the 
following notations with reference to Figure 27, and assume that the (integer) time instant we are interested in is the k*: 
(J) Si is the generic state at time k, belonging to the set S = fS / . .S N } . 

(2) S7 0* 1 is one of the precursors of S, , and precisely the one defined by the information symbol u " emitted during the 
transition 57 (u % ) -> sf 

(3) ST («) is one of the successors of Si , and precisely the one defined by the information symbol u emitted during the 
transition S, -*ST (w) . 

(4) To each transition in the trellis, a signal x is associated, which depends on the state from which the transition originates 
and on the information symbol u detennining that transition. When necessary, we will make this dependence explicit by 
writing x(u \ Si ) when the transition ends in Si and xfSi ,u) when the transition originates from Si ■ 

1 .3.1 The BCJR Algorithm 

The BCJR is the optimum algorithm to produce the sequence of APR We consider first the original version of the 

algorithm, which applies to the case of a finite index set K = fl n} and requires the knowledge of the whole received 

sequence^ y i% —y n ) to work. In the following, the notations u. c, jc, and y will refer to sequences n-symbols long, and the 
integer time variable k will assume the values /, As for the previous assumption, the encoder admits a trellis 

representation with N states, so that the code sequences c (and the corresponding transmitted signal sequences x) can be 
represented as paths in the trellis and uniquely associated with a state sequence s = (so.^.ss) whose first and last states, s 0 and 
s» , are assumed to be known by the decoder. 

Infilling the a posteriori transition probabilities from state Si at time A- as 

<Tk(Si , u) = P( Uk = u . sk-i = Si I y) (35) 
The APP P (u\y) we want to compute can be obtained as 

PkMy) = Zcr* (Si.u) (36) 

Si 

Thus, the problem of evaluating the APP is equivalent to that of obtaining the a posteriori transition probabilities 
defined in Equation (35). The APP can be computed as 

crt(Si,u) = ha atc.i(Si) y k (x(Si , u)) 0 k (SJ(u)) (37) 

where; 

• // a is such that *Z& k (Si*u) = I 

• 7k (x( Si m)) are the joint probabilities already defined in Equation (33), i.e.. 

y k (x) = P(y k .xk = x) = P(y k \xt = x)P( Xk ~ xj (38) 
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The can be calculated from the knowledge of the a priori probabilities of the channel input symbols x and of the 
transition probabilities of the channel P fy k lx*=x). For each time k y there are hi different values of y to be computed, 
which are then associated to the trellis transitions to form a sort of branch metrics. This information is provided by 
the symbol-by-symbol soft-output demodulator. 

cck (Si) are the probabilities of the states of the trellis at time k conditioned on the past received signals, namely, 

at (Si) = P(s k =Si I y)) (39) 
where y\ denotes the sequence y y*. They can be obtained by the forward recursion: 
ak(Si) = h a Zae-i (Sl(u)) r k (x(u,Si)) (40) 

u 

with h a & constant determined through the constraint 



Eat (Si) = / 

St 



and where the recursion is initialized as 



ao(Si) = \ \ (41) 

I 0 otherwise J 



P t (Si) are the probabilities of the trellis states at time k conditioned on the future received signals P(sk= St l^+i )* 
They can be obtained by the backward recursion 

flt(Si) = hp Z (Si (u)) r k+l (x(Si,u)) (42) 



with hp a constant obtainable through the constraint 



and where the recursion is initialized as 



Z ft k (SiJ = 1 

Si 



P„(Si) = \ \ (43) 

I 0 otherwise J 
We can now formulate the BC JR algorithm by the following steps: 

(1) Initialize aoand /? n according to Equations (41) and (43). 

(2) As soon as each term y k of the sequence y is received, the demodulator supplies to the decoder the "branch metrics" 
y k of Equation (38), and the decoder computes the probabilities a* according to Equation (40). The obtained 
values of au(Si ) as well as the y k are stored for all Jt, s^andx. 

(3) When the entire sequence y has been received, the decoder recursively computes the probabilities P k according to the 
recursion of Equation (42) and uses them together with the stored a's and &s to compute the a posteriori transition 
probabilities ak(Si*u) according to Equation (37) and, finally, the APP P k (u\y) from Equation (36). 

1.3.2 The Sliding Window BCJR fSW-BCJR^ 

The BCJR algorithm requires that the whole sequence have been received before starting the decoding process. In 
this aspect, it is similar to the Viterbi algorithm in its optimum version. To apply it in a PMCCC, we need to subdivide the 
information sequence into blocks, decode them by terminaung the trellises of both CCs, and then decode the received sequence 
block by block. Beyond the rigidity, this solution also reduces the overall code rate. 
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A more flexible decoding strategy is offered by a modification of the BCJR algorithm in which the decoder operates 
on a fixed memory span, and decisions are forced with a given delay D. We call this new, and sub-optimal, algorithm the 
sliding window BCJR (SW-BCJR) algorithm. We will describe two versions of the sliding window BCJR algorithm that differ 
in the way they overcome the problem of initializing the backward recursion without having to wait for the entire sequence. We 
will describe the two algorithms using the previous step description suitably modified. Of the previous assumptions, we retain 
only that of the knowledge of the initial state so , and thus assume the transmission of semi-infinite code sequences, where the 
time span K ranges from 1 to oo. 

1.3.2.1 . The First Versi on of the Sliding Window BCJR Algorithm (SWl-BCJR^ 
Here are the steps: 

( 1 ) Initialize ao according to Equation (4 1 ). 

(2) Forward recursion at time k: Upon receiving y k , the demodulator supplies to the decoder the M distinct branch 
metrics, and the decoder computes the probabilities ak (Si) according to Equations (38) and (40). The obtained 
values of ak ( Si) are stored for all 5, , as well as the ak (x) . 

(3) Initialization of the backward recursion (k>D): 

fi k (Sj) - at(Sj) VSj (44) 

(4) Backward recursion: It is performed according to Equation (42) from time k - J back to time k -D. 

(5) The a posteriori transition probabilities at time k -D are computed according to 

a k . D (Si,u) = ha a k - D -i(Si) y kmD (x(Si.u)) P k „ D (St(u)) (45) 

(6) The APP at time k -D is computed as 

Pk-D0*\y) = ?Lcrk-D(Si,u) (46) 

Si 

For a convolution^ code with parameters (k 0 number of states N , and cardinality of the code alphabet, 
M = 2"° , the SWI-BCJR algorithm requires storage of N *D values of a's and M *D values of the probabilities y k (x) 

generated by the soft demodulator. Moreover, to update the a's and P's for each time instant, the algorithm needs to perform 
M x2 ko multiplications and N additions of 2 ko numbers. To output the set of APP at each time instant, we need a D-times 

long backward recursion. Thus, the computational complexity requires overall (D+l) Mx 2 ko multiplications and (D +1) M 

additions of 2 ko numbers each 

As a comparison, the Viterbi algorithm would require, in the same situation, Mx2 ko additions and Mx2 ko -way 
comparisons, plus the trace-back operations, to get the decoded bits. 

1 .3.2.2 The Second. S implified Version of the Sliding Window BCJR Algorithm fSW2-BCJR^ 

A simplification of the sliding window BCJR that significantly reduces the memory requirements comprises of the 
following steps: 

(1) Initialize ao according to Equation (41). 

(2) Forward recursion (k > D): If* > D, the probabilities cc k ~ D -\(Si) are computed according to Equation (40). 

(3) Initialization of the backward recursion (k > D): 

Pt(Sj) - V Sj (47) 

N 

(4) Backward recursion (k > D): It is performed according to Equation (42) from time k-l back to time k-D. 

(5) The a posteriori transition probabilities at time k - D are computed according to 
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a k . D (Si.u) = ha a k -D-i(Si) r k . D (x(Si.u)) fi k , D (Sl(u)) (48) 
(6) The APP at time k - D is computed as 

Pk-D(u\y) = T.(Tk-D(Si,u) (49) 

This version of the sliding window BCJR algorithm does not require storage of the N * D values of a's as they are 
updated with a delay of D steps. As a consequence, only N values of a's and M*D values of the probabilities y k (x) generated 
by the soft demodulator must be stored. The computational complexity is the same as the previous version of the algorithm. 
However, since the initialization of the recursion is less accurate, a larger value of D should be set in order to obtain the same 
accuracy on the output values P^d (u\y). This observation will receive quantitative evidence in the section devoted to simulation 
results. 

1.3.3 Additive Algorithms 
1.3.3.1 The Log-BCJR 

The BCJR algorithm and its sliding window versions have been stated in multiplicative form. Owing to the 
monotonicity of the logarithm function, they can be converted into an additive form by conversion to logarithms. Let us define 
the following logarithmic quantities: 

T k (x) = log [y(x)J 
A k (Si) « log [ ak (Si)J 
B k (Si) = log lP k (SO] 
2 k (Si,u) = log [a k (Si.u)J 
These definitions lead to the following A and B recursions, derived from Equations (40), (42), and (37): 



A k (Si) = log |^ ^eWds-du))^ TMU.S!))) j + Ha (50) 
B k (Si) - log £ j + Hb (51) 



Y. k (Si.u) = At-i(Si) + Y k (x(Si.u)) + & k (S!(u)) + Hz (52) 
with the following initializations: 

I (f Si - so\ 



Ao(St) = 
Bi(Si) = 



-oo otherwise) 

1 if Si = Sn\ 



-oo otherwise) 
1 .3.3.2 Simplified Versions of the Log-BCJR 

The problem in the recursions defined for the log-BCJR comprises of the evaluation of the logarithm of a sum of 
exponential: 



log 



An accurate estimate of this expression can be obtained by extracting the term with the highest exponential, 

Am = max { Ai } 



so that 
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log 



Z = Am + log j J ■+■ Z e ^ ' Am) } (53) 

L * J V A,* Am - J 



and by computing the second term of the right-hand side (RHS) of Equation (53) using lookup tables. 

However, when Am > > A , , the second term can be neglected. This approximation leads to the additive logarithmic- 
BCJR (AL-BCJR) algorithm: 

5 At(Si) = max [ A k -i(Si(u)) + T k (x(u,Si))\ + H A (54) 

3*fS<; ^ max [ Bt*i(STM) + r* + jfS?rWjl + ( 55 > 

Z*rS,-.«; = A k ., (&) + TkWSi.u)) + Bk(STM) + //r (56) 
with the same initialization of the log-BCJR. 

Both versions of the SW-BCJR algorithm described can be used, with obvious modifications, to transform the block 
10 log-BCJR and the AL-BCJR into their sliding window versions, leading to the SW-log-BCJR and the SWAL1-BCJR and 
SWAL2-BCJR algorithms. 

1 .3.4. Explicit Algorithms for Some Particular Cases 

In this section, we will make explicit the quantities considered in the previous algorithms , descriptions by making 
assumptions on the code type, modulation format, and channel. 
15 1 .3.4. 1 . Rate 1/n Binary Systematic Convolutional Encoder 

In this section, we particularize the previous equations in the case of a rate l/n binary systematic encoder associated 
to n binary-pulse amplitude modulation (PAM) signals or binary phase shift keying (PSK) signals. 

The channel symbols x and the output symbols from the encoder can be represented as vectors of n binary 
components: 

20 c - [ci.-.CnJ a e fO.JJ 

x = /*/.-.., x„7 xi e (AM) 

Xk = f Xkl>—*Xkn] 

y k = fyw—ytrnJ 

where the notations have been modified to show the vector nature of the symbols. The joint probabilities y k (x) , over a 
25 memory less channel, can be split as 

X* <® = ft P(y tJxkm = XnJ P( Xkm - Xk) (57) 

171=7 

Since in this case the encoded symbols are n-tuple of binary symbols, it is useful to redefine the input probabilities, y y 
in terms of the likelihood ratios: 

, _ P(y lm i x*» = a) 

yikm 



P < - V tm i Xlcm = -A) 



30 xL = P(Xkm = A) 

*" P(Xkm = -A) 



so that, from Equation (57), 



=/ ' • A km J Ak 



where h y takes into account all terms independent of .r 
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The BCJR can be restated as follows: 

a k (S0 = h Y h a I a k -i(SiM) ft I kkm X^f 4 ^ 

u nr=l 

CTk(Si.u) = h r h„ a k .,(Si) 11 fA**m ^ +/>m /- , " s '' p k (SJ(u)) 



(58) 
(59) 
(60) 



whereas its simplification, the AL-BCJR algorithm, becomes 

Aic(Si) = max ] A k -,(Sl(u)) + £ c m (u.Si) (A^ + [ + H A (61) 

» I m=l J 

fl*fS„> = max J Bk+i(St(u)) +■ £ c m (S„u) (Akm T A^J 1 + Hb (62) 

» I m=l J 

'Zk(Si.u) = J 4*-#fSJ + 2 c m (Si,u)(Akn, + \iJ + Bt(St(u)) (63) 

where /l stands for the logarithm of the corresponding quantity X 
1.3.4.2 The Additive White Gaussian Noise Channel 

When the channel is an additive white Gaussian noise (AWGN) channel, we obtain the explicit expression of the log- 
likelihood ratios Ajb as 



A*, = lo; 



P(y ki \xjo = A) 
P(y ki \x ki =_A 



= log 



2A 



Hence, the AL-BCJR algorithm assumes the following form: 

At(Si) - max \ A k .i(SlM) + £ cmfaSi) (^y km + \£j 1 + Ha (64) 

Bt(Si) - max \ B k +i(St(u)) + 2 c-f&.w; (^y km + Aj£j 1 + tf* (65) 
« I m=i or J 



n 24 
m=i Cj 



(66) 



We will consider turbo codes with rate 1/2 component convolutional codes transmitted as binary PAM or binary PSK 
over an AWGN channel. 

1.3.5. Iterative Decoding of Parallel Concatenated Convolutional Codes 

In this section, we will show how the MAP algorithms previously described can be embedded into the iterative 
decoding procedure of parallel concatenated codes. We will derive the iterative decoding algorithm through suitable 
approximations performed on maximum-likelihood decoding. The description will be based on the fairly general parallel 
concatenated code shown in Figure 28, which employs three encoders and three interleaves (denoted by it in the figure). 
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Let u k be the binary random variable taking values in {0,1}, representing the sequence of information bits 
u= < Ul w *>- ^ optimum decision algorithm on the A* bit u k is based on the conditional log-likelihood ratio L k : 

P(u„ = 0\y) 

Z P(y\u)UP(uj) 
Lk = log^- £* - log^"*^ 

u,uk=0 j*k 

z PMxaojiiPfu,) 

U = log^i- fiS + log - 1> (67) 

where, in Equation (67), P (uj) are the a priori probabilities. 

If the rate kjn. constituent code is not equivalent to a punctured rate 1/n •„ code (in this case the infonnaUon send is 
the information data and one parity bit, the parity bit sent is different every time) or if turbo trellis-coded modulation is used, 
we can first use the symbol MAP algorithm as described in the previous sections to compute the log-likelihood ratio of a 
symbol u=u ; Uha, given the observation yas 

M u) = log 

P(0\y) 

where 0 corresponds to the all-zero symbol. Then we obtain the log-likelihood ratios of the /* bit within the symbol by 

Z e Mu> 

Uui> - ,o g ^ 
In this way, the turbo decoder operates on bits, rather than symbol, interleaving is used. 

To explain the basic decoding concept, we restrict ourselves to three codes, but extension to several codes is 
straightforward. In order to simplify the notation, consider the combination of the interleaver and the constituent encoder 
connected to it as a block code with input u and outputs*, , , =0.1.2.3 (x 0 =u) and the corresponding received sequences as.v, . / 
=0. 1.2.3. The optimum bit decision metric on each bit is (for data with uniform a priori probabilities) 

Z P(y 0 \u) P(y,\u) P(y 2 \u) P(y 3 \u) 
L k = log-^ m) 

Z P(y 0 \»)P(yM)P(y 2 \u)P(y } \u) (W) 

but, in practice, we cannot compute Equation (68) for large /, because the permutations « . Xj imply that y 3 and y } are no 
longer simple convolutional encodings of u. Suppose that we evaluate PCvA«).i=0.2.3 in Equation (68) using Bayes 1 rule and 
using the following approximation: 

P<»\y,) " A P,(utJ (69) 
*=/ 

Note that P(u[ Vi ) is not separable in general. However, for i =0. P(u\y 0 ) is separable; hence, Equation (69) holds 
with equality. So we need an algorithm that approximates a nonseparable distribution P (u\y , ) = P with a separable 

,v 

distribution n Pi(ut) = Q. The best approximation can be obtained using the Kullback cross-entropy minimizer, which 

minimizes the cross-entropy H(Q.P)=E{log(Q/P )} between the input P and the output O. 

The MAP algorithm approximates a nonseparable distribution with a separable one; however it is not clear how good 
it is compared with the Kullback cross-entropy mirumizer. Here we use the MAP algorithm for such an approximation. In the 
iterative decoding, as the reliability of the {u k } improves, intuitively one expects that the cross-entropy between the input and 
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the output of the MAP algorithm will decrease, so that the approximation will improve. If such an approximation, i.e., Equation 
(69), can be obtained, we can use it in Equation (68) for /=2 and i=3 (by Bayes' rule) to complete the algorithm. 
Define Zit by 

put La 

? «™ - i~rjn (70 > 

where u k € {0,1}. To obtain { p i } or, equivalently { £ ik } , we use Equations (69) and (70) for i =0,2,3 (by Bayes' rule) to 
express Equation (68) as 

L k = f( y, . Lo> L 2 * L 3 *k) + Z 0k + i 2k + i 3k (71) 
where Zok = 2Ayd/cr (for binary modulation) and 

f(y,.U. Z,. Z,.*> - ^ (*> 

We can use Equations (69) and (70) again, but this time for / =0,7,5, to express Equation (68) as 
Lk = f( y 2 > L 0 > Li. Zs.Q + Lot + Lit + Tjjt (73) 

and similarly, 

= f( y s > Lo + Li > L 2 *k) + Zoic + i Jk + £^ (74) 
A solution to Equations (71 ), (73), and (74) is 

Lik = f( yt* Lo> L 2 > L 3 . k) 
Lik f( y 2 > L 0 . Li* I*. k) (75) 
Lik " f( y 3 * L 0 > Li > L 2 > k ) 
for k =1,2, '.n. provided that a solution to Equation (75) does indeed exist. The final decision is then based on 

Lk - Lok + Lik + L 2k + L 3k (76) 
which is passed through a hard limiter with zero threshold. We attempted to solve the nonlinear equations in Equation (75) 
f° T Li*L 2 > and L 3 by using the iterative procedure: 

Z5T" = af>f( y t , L 0 > Vf . . k) (77) 
for k =7.2.— iterating on m. Similar recursions hold for ZTk and ZTk . 

We start the recursion with the initial condition Z\° } =£2°' = Vz } = Lo - For computation oif(), we can 
use any MAP algorithm as described in the previous sections, with interleaves (direct and inverse) where needed; call this the 
basic decoder D, , / =7.2.5. The * ' =7.2.5 represent the extrinsic information. The signal flow graph for extrinsic 

information is shown in Figure 29, which is a fully connected graph without self-loops. Parallel, serial, or hybrid 
implementations can be realized based on the signal flow graph (in this figure y 0 is considered as part of yj). Based on our 
equations, each node's output is equal to internally generated reliability L minus the sum of all inputs to that node. The BCJR 
MAP algorithm always starts and ends at the all-zero state since we always terminate the trellis. We assumed /r t =J identity; 
however, any n\ can be used. 

The overall decoder is composed of block decoders D * connected in parallel, as in Figure 30 (when the switches are 
in position P), which can be implemented as a pipeline or by feedback. A serial implementation is also shown in Figure 30 
(when the switches are in position S. For those applications where the systematic bits are not transmitted or for parallel 
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concatenated trellis codes with high-level modulation, we should set Zo =0 - Even in the presence of systematic bits, if 
desired, one can set Zo = 0 and consider yo as part of v; If the systematic bits are distributed among encoders, we use the 
same distribution for y 0 among the received observations for MAP decoders. 

At this point, further approximation for iterative decoding is possible if one term corresponding to a sequence u 
dominates other terms in the summation in the numerator and denominator of Equation (72). Then the summations in Equation 
(72) can be replaced by "rnaximum" operations with the same indices, i.e., replacing Eu uk-i with max u;i *-, for i =0,1. A 
similar approximation can be used for £2* and £ 34r in Equation. (75). This sub-optimal decoder then corresponds to an 
iterative decoder that uses AL-BCJR rather than BCJR decoders. As discussed, such approximations have been used by 
replacing, with "max" in the log-BCJR algorithm to obtain AL-BCJR. Clearly, all versions of SW-BCJR can replace 
BCJR (MAP) decoders in Figure 30. 

For turbo codes with only two constituent codes, Equation (77) reduces to 

ZST" - ap>f(y s . Zo. V? >k) 
= af>f(y 2 , Z 0 . 2T .» 
for k =1.2.-,n t and m =1.2-. where, for each iteration, a ( m; and a f } can be optimized (simulated annealing) or set to 1 for 
simplicity. The decoding configuration for two codes is shown in Figure 31. In this special case, since the paths in Figure 31 
are disjointed, the decoder structure can be reduced to a serial mode structure if desired. If we optimize a{ m) and a ^" } , this 
requires estimates of the variances of Zu and £2* *° r each iteration in the presence of errors. 

In the results presented in the next section, we will use a PMCCC with only two constituent codes. 
1.3.6. Simulation Results 

In this section, we will present some simulation results obtained applying the iterative decoding algorithm, which, in 
turn, uses the optimum BCJR and the sub-optimal, but simpler, SWAL2-BCJR as embedded MAP algorithms. All simulations 
refer to a rate 1/3 PMCCC with two equal, recursive convolutional constituent codes with 16 states and generator matrix 

<HD)-\l. J + D+ * * ° 4 ' 
L 1 + D 3 + D 4 

and an interleaver of length 16,384, using an S-random permutation with S = 40. Each simulation run examined at least 
25,000,000 bits. In Figure 32, we plot the bit-error probabilities as a function of the number of iterations of the decoding 
procedure using the optimum block BCJR algorithm for various values of the signal-to-noise ratio. It can be seen that the 
decoding algorithm converges down to bit error rate (BER) ~ 10' 5 at signal-to-noise ratios of 0.2 dB with nine iterations. The 
same curves are plotted in Figure 33 for the case of the sub-optimum SWAL2-BCJR algorithm. In this case, 0.75 dB of 
signal-to-noise ratio is required for convergence to the same BER and with the same number of iterations. 

In Figure 34, the bit-error probability versus the signal-to-noise ratio is plotted for a fixed number (5) of iterations of 
the decoding algorithm and for both optimum BCJR and SWAL2-BCJR MAP decoding algorithms. It can be seen that the 
penalty incurred by the sub-optimum algorithm amounts to about 0.5 dB. 

Algorithms were of the block type. The penalty is completely attributable to the approximation of the sum of 
exponentials. To verify this, we have used a SW2-BCJR and compared its results with the optimum block BCJR, obtaining the 
same results. 

Finally, in Figures 35 and 36, we plot the number of iterations needed to obtain a given bit-error probability versus 
the bit signal-to-noise ratio, for the two algorithms. These curves provide intbrmation on the delay incurred to obtain a given 
reliability as a function of the bit signal-to-noise ratio. 
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1,3.7 Circuits to Implement the MA P Algorithm for Decoding Rate 1/n Component Codes of a PMCCC 

We show the basic circuits required for the implementation of a serial additive MAP algorithm for both block 
log-BCJR and SW-log-BCJR. Extension to a parallel implementation is straightforward. Figure 37 shows the implementation 
of Equation (50) for the forward recursion using a lookup table for evaluation of log(l+e* ) t and subtraction of maxj{A k (S J) 
from Ak(S J is used for normalization to prevent buffer overflow. The circuit for maximization can be implemented simply by 
using a comparator and selector with feedback operation. Figure 38 shows the implementation of Equation (51) for the 
backward recursion, which is similar to Figure 37. A circuit for computation of log(P k (u\y)) from Equation (36) using 
Equation (52) for final computation of bit reliability is shown in Figure 39. In Figure 39, switch 1 is in position 1 and switch 2 
is open at the start of operation. The circuit accepts £ k (S , ,u) for i - 7, then switch 1 moves to position 2 for feedback 
operation. The circuit performs the operations for i =1.2.~\N. When the circuit accepts £ k (S t ,u) for i = N , switch 1 goes to 
position 1 and switch 2 is closed. This operation is done for u=J and u=0. The difference between log (P k (l\y)) and log (P k 
(0\y)) represents the reliability value required for turbo decoding, i.e., the value of L k in Equation (67). 

We propose two simplifications to be used for computation of log (l+e") without using a lookup table. 

Approximation 1: We used the approximation log(J+e x ) «r-ax+ b , 0 < x < b/a where b=log(2), and we selected a 
=0.3 for the simulation. We observed about O.ldB degradation compared with the full MAP algorithm for the code. The 
parameter a should be optimized, and it may not necessarily be the same for the computation of Equation (50), Equation (51), 
and logfPtfuty)) from Equation (36) using Equation (52). We call this "linear" approximation. 

Approximation 2: We take 

f 0 if x > /7I 
\og(l + e x ) ~ \ \ 
[cifx<T}) 

We selected c=log(2) and the threshold 17 =1.0 for our simulation. We observed about 0.2 dB degradation compared 
with the full MAP algorithm for the code. This threshold should be optimized for a given SNR, and it may not necessarily be 
the same for the computation of Equation (50), Equation (51), and log(P k (u\y)) from Equation (36) using Equation (52). If we 
use this approximation, the log-BCJR algorithm can be built based on addition, comparison, and selection operations without 
requiring a lookup table, which is similar to a Viterbi algorithm implementation. We call this "threshold" approximation. At 
most, 8 to 10 bit representation suffices for all operations. 
1.3.8 Trellis Termination 

If needed, the encoder in Figure 28 may generate a n(N + hi), N) block code, where the hi tail bits of encoder 2 and 
encoder 3 are not transmitted. Since the component encoders are recursive, it is not sufficient to set the last hi information bits 
to zero in order to drive all the encoder to the all zero state, i.e. to terminate the trellis. The termination (tail) sequence depends 
on the state of each component encoder after N bits, which makes it impossible to terminate the component encoders with just 
Ambits. This issue has not been resolved in previously proposed turbo code implementations. Fortunately, the simple stratagem 
illustrated in Figure 33 is sufficient to tenuinate the trellis at the end of the block. (The code shown is not important). Here the 
switch is in position **A" for the first N clock cycles and is in position "B" for hi additional cycles, which will flush the 
encoders with zeros. The decoder does not assume knowledge of the hi tail bits. The same termination method may be used for 
all encoders. 

1.3.9. Weight Distribution 

In order to estimate the performance of a code, it is necessary to have information about its minimum distance, weight 
distribution, or actual code geometry, depending on the accuracy required for the bounds or approximations. The challenge is in 
finding the pairing of codewords from each individual encoder, induced by a particular set of interleavers. Intuitively, we would 
like to avoid joining low-weight codewords from one encoder with low-weight words from the other encoders. In the example 
of Figure 28, the component codes have distances 5, 2 and 2. This will produce a worst-case rriinimum distance of 9 for the 
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overall code. Note that this would be if the encoders were not recursive since, in this case, the minimum weight word for all 
three encoders is generated by the input sequence tt=(00...0000100...000) with a single "1", which will appear again in the 
other encoders, for any choice of interleavers. This motivates the use of recursive encoders, where the key ingredient is the 
recursiveness and not the feet that the encoders are systematic. For our example, the input sequence u=(00...00100100...000) 
generates a low weight codeword with weight 6, for the first encoder. If the interleavers do not "break" this input pattern, the 
resulting code-words weight will be 14. In general weight-2 sequences with 2+3/ zeros separating the 1 *s would result in a total 
weight of 14+6/ if there were no permutations, permutations before the second and third encoders, a 2 sequence with its 1 's 
separated by 2+3/i zeros will be permuted into two other weight-2 sequences with 1 's separated by 2+3// zeros, #=2,3,.. where 
each u is defined as a multiple of 1/3. If any /, is not an integer, the corresponding encoded output will have a high weight 
because then the convolutional code output is non-terminating (until the end of the block). If all //s are integers, the total 
encoded weight will be 14+2L,-! 3 /, . Thus, one of the considerations in designing the interleaver is to avoid integer triplets (//, 
/_% ta) that are simultaneously small in all three components. In fact, it would be nice to design an interleaver to guarantee that 
the smallest value of U (for integer /,) grows with the block size M 

For comparison we consider the same encoder structure in Figure 28, except with the roles of ga and gb reversed. 
Now the minimum distances of the three component codes are 5, 3, and 3, producing an overall minimum distance of 1 1 for the 
total code without any permutations. This is apparently a better code, but it turns out to be inferior as a turbo code. This 
paradox is explained by again considering the critical weight-2 data sequences. For this code, weight-2 sequences with 1+2// 
zeros separating the two l's produce self-terminating output and hence low-weight encoded words. In the turbo encoder, such 
sequences will be permuted to have separations 1+2/,, i= 2, 3, for the second and third encoders, where now each /, is defined 
as a multiple of 1/2. But now the total encoded weight for integer triplets (//, t 3 , tj) is iV+<£-/ /,. Notice how this weight 
grows only half as fast with 2/-/ 3 U as the previously calculated weight for the original code. If <£=//, can be made to grow 
with block size by proper choice of interleaver, then clearly it is important to choose component codes that cause the overall 
weight to grow as fast as possible with the individual separations /,. This consideration outweighs the criterion of selecting 
component codes that would produce the highest minimum distance if unpermuted. 

There are also many weight-//, n = 3, 4, 5, data sequences that produce self-terminating output and hence low 
encoded weight However, these sequences are much more likely to be broken up by the random interleavers than the weight-2 
sequences and are therefore likely to produce non-tenninating output from at least one of the encoders. Thus, turbo code 
structures, which would have low minimum distances if unpermuted, can still perform well if the low-weight codewords of the 
component codes are produced by input sequences with weight higher of two. 
1.3.10. Weight Distribution with random interleavers 

Now we briefly examine the issue of whether one or more random interleavers can avoid matching small separations 
between the l's of a weight-2 data sequence with equally small separations between the Ts of its permuted version(s). 
Consider for example a particular weight-2 data sequence (...001001000...) which corresponds to a low weight codeword in 
each of the encoders of Figure 28. If we randomly select an interleaver of size N 9 the probability that this sequence will be 
permuted into another sequence of the same form is roughly 2IN (assuming that N is large, and ignoring minor edge effects). 
The probability that such an unfortunate pairing happens for at least one possible position of the original sequence 
(...001001000...) within the block size of A', is approximately l-(l-2/Nf*l-e* 2 . This implies that the minimum distance of a 
two-code turbo code constructed with a random permutation is not likely to be much higher than the encoded weight of such an 
unpermuted weight-2 data sequence, e.g. 14 for the code in Figure 28. (For the worst case permutations, the d min of the code is 
sull 9, but these permutations are highly unlikely if chosen randomly). By contrast, if we use three codes and two different 
interleavers, the probability that a particular sequence (...001001000...) will be reproduced by both interleavers is only (2X) : 
Now the probability of finding such an unfortunate data sequence somewhere within the block of size N is roughly /-f7-2A? v * 
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4/N. Thus it is probable that a three-code turbo code using two random interleaves will see an increase in its minimum 
distance beyond the encoded weight of an unpermuted weight-2 data sequence. This argument can be extended to account for 
other weight-2 data sequences which may also produce low weight codewords, e.g. (...00100(000)' 1000...), for the code in 
Figure 28. For comparison, let us consider a weight-3 data sequence such as (...0011100...) which for our example corresponds 
to the minimum distance of the code (using no permutations). The probability that this sequence is reproduced with one 
random interleaver is roughly and the probability that some sequence of the form (...0011100...) is paired with another of 
the same form is l-(l-6/N 2 /' m&N. Thus for large block sizes, the bad weight-3 data sequences have a small probability of 
being matched with bad weight-3 permuted data sequences, even in a two-code system. For a turbo code using q codes and q-\ 
random interleavers this probability is even smaller, l-(l-(6/N>r'f (6/N)(6^f 3 . This implies that the minimum distance 
codeword of the turbo code in Figure 28 is more likely to result from a weight-2 data sequence of the form (...001001000...) 
than from the weight-3 sequence (...0011100...) that produces the minimum distance in the unpermuted version of the same 
code. Higher weight sequences have even smaller probability of reproducing themselves after being passed through a random 
interleaver. For a turbo code using q codes and q-\ interleavers, the probability that a weight-H data sequence will be 
reproduced somewhere within the block by all q-l permutations is of the form l-(I-(fiW'p-'f where 0 is a number that 
depends on the weight-/* data sequence but does not increase with block size N. For large N, this probability is proportional to 
1/hT™ , which falls off rapidly with N, when n and q are greater than two. Furthermore, the symmetry of this expression 
indicates that increasing either the weight of the data sequence n or the number of codes q has roughly the same effect on 
lowering this probability. In summary, from the above arguments we conclude that weight-2 data sequences are an important 
factor in the design of the component codes, and that higher weight have decreasing importance. Also, increasing the number of 
coders may result in better turbo codes. 

The minimum distance is not the most important quantity of the turbo code, except for its asymptotic performance, at 
very high Et/N 0 At moderate SNRs, the weight distribution for the first several possible weights is necessary to compute the 
code performance. Estimating the complete weight distribution of these codes for large N and fixed interleavers is still an open 
problem. However, it is possible to estimate the weight distribution for large N for random interleavers by using probabilistic 
arguments. 

1.3.11. Interleaver design 

Interleavers should be capable of spreading low-weight input sequences so that the resulting codeword has high 
weight. Block interleavers, defined by a matrix with or rows and uc columns such that N =ur x uc, may fail to spread certain 
sequences. For example, the weight 4 sequence shown in Figure 39 cannot be broken by a block interleaver. In order to break 
such sequences random interleavers are desirable. Block interleavers are effective if the low-weight sequence is confined to a 
row. If low-weight sequences (which can be regarded as the combination of lower weight sequences) are confined to several 
consecutive rows, then the oc columns of the interleaver should be sent in a specified order to spread as much as possible the 
low-weight sequence. As can be observed in the example in Figure 39, the sequence 1001 will still appear at the input of the 
encoders for any possible column permutation. Only if we permute the rows of the interleaver in addition to its columns it is 
possible to break the low-weight sequences. Appropriate selection of a, and q for rows and columns depends on the particular 
set of codes used and on the specific low-weight sequences that we would like to break. We have also designed random 
permutations (interleavers) by generating random integers i ,1 s i £ N, without replacement. We define a "S-random" 
permutation as follows: -each randomly selected integer is compared to S previously selected integers. If the current selection is 
equal to any S previous selections within a distance of ±5, then the current selection is rejected. This process is repeated until 
all N integers are selected. While the searching time increases with 5. we observed that choosing S < A'2) w usually produces 
a solution in reasonable time. (For S = 1 we have a purely random interleaver). In the simulations we used 5=11 for A' = 256 
and S = 31 tor .V =4096. 
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The advantage of using ihree or more constituent codes is that the corresponding two or more interieavers have a 
better chance to break sequences that were not taken care by another interleaver. The disadvantage is that, for an overall 
desired code rate, each code must be punctured more, resulting in weaker constituent codes. It has been shown that randomly 
selected interieavers and interieavers based on the row-column permutation described above. In general, randomly selected 
permutations are good for low SNR operation (e.g., PCS applications requiring P b (e) = 10° ) where the overall weight 
distribution of the code is more important than the rninimum distance. 

1 .3. 12. Performance with two codes 

The performance obtained by turbo decoding the code with two constituent codes (1, gb/ga j, where ga =(3J)octal 
and gb =(2\)octal , and with random permutations of lengths N = 4096 and (Note that the components of the Z *s 
corresponding to the tail bits are set to zero for all iterations). N = 16384 is compared in Figure 40 to the capacity of a binary- 
input Gaussian channel for rate r = 1/4. The best performance curve in Figure 40 is approcimately 0.7 dB torn the Shannon 
limit at BER=10"V 

1 .3.13. P erformance with Unequal Rate Encoders. 

We now extend the results to encoders with unequal rates with two A' = 5 constituent codes (\<gb/ga . gc/ga) and 
(gb/ga A where ga = (37)octai , gb =(33*>cta/ and gc =(2S)octal . This structure improves the performance of the overall, rate 
1/4, code, as shown in Figure 40. This improvement is due to the fact that we can avoid using the interleaved information data 
at the second encoder and that the rate of the first code is lower than that of the second code. For PCS applications, short 
interleaver should be used, since the vocoder frame is usually 20ms. Therefore 192 and 256 bits interieavers as an example, 
corresponding to 9.6 and 13 Kbps. The performance of codes with short interleaver is shown in Figure 41 for the K= 5 codes 
described above for random permutation and row-column permutation with a = 2 for rows and a = 4 for columns. 

1.3.14. Performance with Three Codes. 

The performance of a three-code turbo code with random interieavers is showing Figure 42 for #=4096. The three 
recursive codes shown in Figure 28 where used for K = 3. Three recursive codes with ga = (\3)octal and gb =(11 )octal 
were used for K = 4. Using K = 4 code has better performance than several others. In Figure 42, the performance of the K = 4 
code was improved by going to 30 iterations and using a S-random interleaver with 5=3 1 . For shorter blocks ( 1 92 and 256), the 
results are shown in Figure 4 1 where it can be observed that arjproximately 1 dB SNR is required for BER=10' 3 , which implies 
a CDMA capacity C = 0.8n_ We have noticed that the slope of the BER curve changes around BER=10 5 (flattening effect) if 
the interleaver is not designed properly to maximize d min or is chosen at random. 
1.4. Comparison Bet ween Parallel and Serially Multiple Concatenated Codes 

In this section, we will use the bit-error probability bounds previously derived to compare the performance of parallel 
and serially multiple concatenated block and convolutional codes. 
1 .4. 1 . Parallel and Seri ally Multiple Concatenated Block Codes 

To obtain a fair comparison, we have chosen the following PMCBC and SMCBC: The PMCBC has parameters (11m, 
3m, N) and employs two equal (7,3) systematic cyclic codes with generator g(D)=(l+D) (1 + D + D* )\ the SMCBC, instead, 
is a (15m, 4m, N) SMCCC obtained by the concatenation of the (7, 4) Hamming code with a (15, 7) BCH code. 

They have almost the same rates (Re, =0.266 and R Cp =0.273), and have been compared choosing the interleaver 
length in such a way that the decoding delay due to the interleaver, measured in terms of input information bits, is the same. As 
an example, to obtain a delay equal to 12 input bits, we must choose an interleaver length N=12 for the PMCBC and N 
=12/F°c=21 for the SMCBC. The results are shown in Figure 25, where we plot the bit-error probability versus the 
signal-to-noise ratio E b >'N 0 for various input delays. The results show that, for low values of the delay, the perfonnances are 
almost the same. On the other hand, increasing the delay (and thus the interleaver length AO yields a significant interleaver gain 
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for the SMCBC and almost no gain for the PMCBC. "The difference in performance is 3 dB at P b (e) =10 ~* in favor of the 
SMCBC. 

1 .4.2. Parallel and Serially Multiple Concatenated Convolutional Codes 

To obtain a fair comparison, we have chosen the following PMCCC and SMCCC: The PMCCC is a rate 1/3 code 
5 obtained concatenating two equal rate 1/2, four-state systematic recursive convolutional codes with a generator matrix as in the 
first row of Table 2. The SMCBC is a rate 1/3 code. It is form using as an outer code the same rate 1/2, four-state code as in the 
PMCCC and, as an inner code, a rate 2/3, four-state systematic recursive convolutional code with a generator matrix as in the 
third row of Table 2. Also, in this case, the interleaver lengths have been chosen so as to yield the same decoding delay, due to 
the interleaver, in terms of input bits. The results are shown in Figure 44, where we plot the bit-error probability versus the 
1 0 signal-to-noise ratio Et/No for various input delays. 

The results show the great difference in the interleaver gain. In particular, the PMCCC shows an interleaver gain 
going as N whereas the interleaver gain of the SMCCC, as from Expression (31), goes as N - (d° f + I)/2 = AT -5 , since the 
free distance of the outer code is equal to 5, which is odd. This means, for P b (e) =10 a gain of more than 2 dB in favor of 
the SMCCC. 

1 5 Previous comparisons have shown that serial concatenation is advantageous with respect to parallel concatenation in 

terms of maximum-likelihood performance. For long interleaver lengths, this significant result remains a theoretical one, as 
maximum-likelihood decoding is an almost impossible achievement. 
2. A SISO MAP Module to Decode Parallel and Serial Multiple Concatenated Codes 

Multiple concatenated coding schemes with interleavers comprises a combination of two simple constituent encoders 

20 and an interleaver. The parallel concatenation has been shown to yield remarkable coding gains close to theoretical limits, yet 
admitting a relatively simple iterative decoding technique. The serial concatenation of interleaved codes may offer a superior 
performance. In both coding schemes, the core of the iterative decoding structure is a soft-input soft-output (SISO) module. 
Here, we describe the SISO module in a form that continuously updates the maximum a posteriori (MAP) probabilities of input 
and output code symbols and show how to embed it into iterative decoders for parallel and serially concatenated codes. 

25 2.1. Introduction 

Both concatenated coding schemes admit a suboptimum decoding process based on the iterations of the MAP 
algorithm applied to each constituent code. Here we describe a SISO module that implements the MAP algorithm in its basic 
form, the extension of it to additive MAP (log-MAP), which is indeed a dual-generalized Viterbi algorithm with correction, and 
finally extension to the continuous decoding of PMCCC and SMCCC. As examples of applications, we will show the results 

30 obtained by decoding two low-rate codes, with very high coding gain. 
2.2. Iterative Decoding of Parallel and Serial Concatenated Codes 

In this section, we show the block diagram of parallel and serially concatenated codes, together with their iterative 
decoders, both iterative decoding algorithms need a particular module, named SISO, which implements operations strictly 
related to the MAP algorithm. 

35 2.2.1. Parallel Concatenated Codes 

The block diagram of a PMCCC is shown in Figure 45 (a) (the same construction also applies to block codes). In 
Figure 45, a rate 1/3 PMCCC is obtained using two rate 1/2 constituent codes (CCs) and an interleaver. For each input 
information bit, the codeword sent to the channel is formed by the input bit, followed by the parity check bits generated by the 
two encoders. In Figure 45 (b), the block diagram of the iterative decoder is also shown. It is based on two modules denoted by 

40 "'SISO,** one for each encoder, an interleaver, and a deinterleaver performing the inverse permutation with respect to the 
interleaver. 

The SISO module is a four-port device (quadriport), with two inputs and two outputs. Here, it suffices to say that it 
accepts as inputs the probability distributions of the information and code symbols labeling the edges of the code trellis, and 
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fonns as outputs an update of these distributions based upon the code constraints. In Figure 45 (b) can be seen that the updated 
probabilities of the code symbols, are never used by the decoding algorithm. 

2.2.2. Serially Multiple Concatenated Codes 

The block diagram of a SMCCC is shown in Figure 46 (a) (the same construction also applies to block codes). In 
Figure 46 (a), a rate 1/3 SMCCC is obtained using as an outer encoder a rate 1/2 encoder, and as an inner encoder a rate 2/3 
encoder. An interleaver permutes the output codewords of the outer code before passing them to the inner code. In Figure 46 
(bX the block diagram of the iterative decoder is shown. It is based on two modules denoted by "SISO", one for each encoder, 
an interleaver, and a deinterleaver. The SISO module is the same as described before. In this case, though, both updated 
probabilities of the input and code symbols are used in the decoding procedure. 

2.2.3. Soft-Output algorithms 

The SISO module is based on MAP algorithms. These algorithms perform both forward and backward recursions and, 
thus, require that the whole sequence be received before starting the decoding operations. As a consequence, they can only be 
used in block-mode decoding. The memory requirement and computational complexity grow linearly with the sequence length. 

Some algorithms require only a forward recursion, so that it can be used in continuous-mode decoding. However, its 
memory and computational complexity grow exponentially with the decoding delay. It is possible to use a MAP 
symbol-by-symbol decoding algorithm conjugating the positive aspects of other algorithms, i.e., a Gxed delay and linear 
memory and complexity growth with decoding delay. All these algorithms are truly MAP algorithms. To reduce the 
computational complexity, various forms of suboptimum soft-output algorithms can be used. Two approaches have been taken. 
The first approach tries to modify the Viterbi algorithm. These augmented outputs include the depth at which all paths are 
merged, the difference in length between the best and the next-best paths at the point of merging, and a given number of the 
most likely path sequences. The same concept of augmented output was later generalized for various applications. A different 
approach to the modification of the Viterbi algorithm comprises of generating a reliability value for each bit of the hard-output 
signal and is called the soft-output Viterbi algorithm (SOVA). In the binary case, the degradation of SOVA with respect to 
MAP is small; however, SOVA is not as effective in the nonbiliary case. The second approach comprises of revisiting the 
original symbol MAP decoding algorithms with the aim of simplifying them to a form suitable for implementation. 
2.3. The SISO Module 
2.3. 1 . The Encoder 

The decoding algorithm underlying the behavior of SISO works for codes admitting a trellis representation. It can be 
a time-invariant or time-varying trellis, and, thus, the algorithm can be used for both block and convolutional codes 

In Figure 47, we show a trellis encoder, characterized by the following quantities (In the following, capital letters U, 
C. S, E will denote random variables and lower-case letters u. c, s, e their realizations. The letter P.fAJ will denote the 
probability of the event /J, whereas the letter P(a) will denote a function of a. The subscript k will denote a discrete time, 
defined on the time index set K. Other subscripts, like /, will refer to elements of a finite set. Also, 4 Y /' will denote a time 
sequence, whereas "{ } n will denote a finite set of elements.): 

1. U =( U k ) h€K is the sequences of input symbols, defined over a time index set K (finite or infinite) and drawn from the 

alphabet U = { ui u Nt } . To the sequence of input symbols, we associate the sequence of a priori probability 

distributions: P.(u;I) = {P k (u k ; I)) keK where P k ( Uk ;I) = P.[{J k = u k ] . 

2. C=( Ck) keK is the sequences of output, or code, symbols, defined over the same time index set AT, and drawn from the 
alphabet C = { c/ , ... , c Vo } To the sequence of output symbols, we associate the sequence of a priori probability 
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distributions: P. (c; J) = (P k (Ck . ] )) keK For simplicity of notation, we drop the dependency of u k and c* on k. Thus, 

Pk(Uk;I) and Pk(Ck;I) will be denoted simply by P t(u; I) and P k(c ; J) respectively. 
2.3.2. The Trellis Section 

The dynamics of a time-invariant convohitional code are completely specified by a single trellis section, which 
describes the transitions (edges) between the states of the trellis at time instants k and k +7. A TrellisO section is 
characterized by the following: 

(1) A set of Estates S -= { si s n } The state of the trellis at time k is S k = 5, with s € S. 

(2) A set of N *Nj edges obtained by the Cartesian product E = Sx U = { e , eNxNf } which represents all possible 

transitions between the trellis states. 

The following functions are associated with each edge e e E (see Figure 48): 

( 1 ) The starting state J (e) (the projection of e onto S). 

(2) The ending state s* (e). 

(3) The input symbol u(e) (the projection of e onto U). 

(4) The output symbol c(e). 

The relationship between these functions depends on the particular encoder. As an example, in the case of systematic 
encoders, (£ (e) c(e)) also identifies the edge since u(e) is uniquely determined by c(e). In the following, we only assume that 
the pair (f (e).u(e)) uniquely identifies the ending state s* (e)\ this assumption is always verified, as it is equivalent to say that, 
given the initial trellis state, there is a one-to-one correspondence between input sequences and state sequences, a property 
required for the code to be uniquely decodable. 
2.3.3. The SISO Algorithm 

The SISO module is a four-port device that accepts at the input the sequences of probability distributions P.(c; I) 
Rfu; I) and outputs the sequences of probability distributions P.(c;0) P.(u;0) based on its inputs and on its knowledge of the 
trellis section (or code in general). We assume first that the time index set K is finite, i.e., K = {l,... r ii}. The algorithm by 
which the SISO operates in evaluating the output distributions will be explained in two steps. In the first step, we consider the 
following algorithm: 

(1 ) At time k, the output probability distributions are computed as 



P k (c:0) = H c S A k -!fs s (e)] P k [u(e);l] P k [c(e);I] B k [s E (e)] (78) 



e:e(€p=c 



? k (u:0) - Hu Z A k .i[s s (e)] P k [u(e);I] P k [c(e);I] B k [s E (e)J (79) 



(2) The quantities A k () and B k (') are obtained through the forward and backward recursions, respectively, as 



A k (s) = Z A k .i[s s (e)] P k [u(e);I] P k [c(e);IJ . k - 1 n (80) 



B k (s) = Z B k +ifs E (e)J P k+J fu(e);IJ P k +rfc(e);l] ,k = n-l 0 (81) 



with initial values 




(82) 




(83) 



The quantities ff c , // u are normalization constants defined as follows: 
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He -> Z P k (c;0) - / 

c 

Hu -+ Z P k (u;Q) = y 

u 

In the second step, from Equations (78) and (79), it is apparent that the quantities P k fc(e); I] in the first equation and 
Pk [u(e); I] in the second do not depend on <?, by definition of the summation indices, and thus can be extracted from the 
summations. Thus, defining the new quantities 

P k (c;0) - „ e h!Ei£L 
Pk(c;I) 

Pk(u: o) = h. 

Pk(u;i) 

where H c and H u are normalization constants such that 

H c -*■ Z Pk(c;0) = / 

C 

H u -+ S P k (u;0) = 1 

U 

It can be easily verified that they can be obtained through the expressions 

Pk(c:0) = H c H c S A^i[s s (e)J P k [u(e);I] B k fs E (e)J (84) 

/>*(i/;Q> = H» Hu 2 A^jfs s (e)J P k [c(e);I] B k [s E (e)] (85) 

e:c(e)=u 

where the /I and B'j satisfy the same recursions previously introduced in Equation (80). 

The new probability distributions P k (u;0) and P k (c;0) represent a smoothed version of the input distributions P k 
(c;I) and P k (u;I), based on the code constraints and obtained using the probability distributions of all symbols of the sequence 
but the kth ones, P k (c;I) and P k (u;I). In the literature of PMCCC decoding, P k (u;0) and P k (c;0) would be called extrinsic 
information. They represent the added value of the SISO module to the a priori distributions Pk(u;I) and P k (c;I). Basing the 
SISO algorithm on P k ( ;0) instead of on p k (.; O) simplifies the block diagrams, and related software and hardware, of the 
iterative schemes for decoding concatenated codes. The SISO module is then represented as in Figure 49. 

Previously proposed algorithms were not in a form suitable for working with a general trellis code. Most of them 
assumed binary input symbols, some also assumed systematic codes, and none (not even the original BCJR algorithm) could 
cope with a trellis having parallel edges. As can be noticed, (from all summations involved in the equations that define the 
SISO algorithm) we work on trellis edges rather than on pairs of states. . This makes the algorithm completely general and 
capable of coping with parallel edges and also with encoders with rates greater than one, like those encountered in some 
concatenated schemes. 

2.3.4. Computation of Input and Output Bit Extrinsic Information 

In this subsection, bit extrinsic information is derived from the symbol extrinsic information using Equations (84) and 
(85). Consider a rate ka/n 0 trellis encoder such that each input symbol U comprises of k a bits and each output symbol C 
comprises of n 0 bits. Assume 

P k (c;I) - Pt,j(c J : I) (86) 

Pk(u:D = H Pl,j (uj;1) (87) 

where c J e {0.1} denotes the value of the jth bit C J k of the output symbol C k = c; j =7 n 0 , and u J e {0,1} denotes the 

value of the jth bit U\ of the output symbol U k = u; j =/ k a , . This assumption is valid in an iterative decoding when bit 
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interleavers rather than symbol interleavers are used. One should be cautious when using P k (c; I) as a product for those 
encoders in a concatenated system where the output C in Figure 47 is connected to a channel. For such cases, if, for an 
example, a nonbinary input additive white Gaussian noise (AWGN) channel is used, this assumption usually is not needed (this 
will be discussed shortly), and P k (c; I)=P k (c\y)= P k (y\x(c))P (c)/P (y), where y is the complex received samples) and x(c) is 
the transmitted nonbinary symbol(s). Then, for binary input memoryless channels. P k (y\x(c)) can be written as a product. After 
obtaining symbol probability distributions P k (c; O) and P k (u; O) from Equations (84) and (85) by using Equations (79) and 
(81), it is easy then to show that the input and output bit extrinsic information can be obtained as 

Pk.jfc'.O) = He* Z P k (c;0) n Ptj( c ';I) (88) 

Pk.j(u>:0> = Z Pk(u;0) n /\ y <V;/; (89) 

where H<J and are normalization constants such that 

H<J -> Z Pk,j(c>;0) = / 
Z Pk,j(u J :0) = I 

Equation (86) is not used for those encoders in a concatenated coded system connected to a channel. To keep the 
expressions general, as is seen from Equations (80), (81 ), and (89), Pk[c(e)il] is not represented as a product. 

In the following sections, for simplicity of notation, the probability distribution of symbols rather than of bits is 
considered. The extension of the results to probability distributions of bits based on the above derivations is straightforward. 
2.4. The Slidine-Window Soft-Input Soft-Output Module (SW-SISQ^ 

As previous description should have made clear, the SISO algorithm requires that the whole sequence has been 
received before starting the smoothing process. The reason is due to the backward recursion that starts from the 
(supposed-known) final trellis state. As a consequence, its practical application is limited to the case when the duration of the 
transmission is short (n small) or, for n long, when the received sequence can be segmented into independent consecutive 
blocks, like for block codes or convolutional codes with trellis termination. It cannot be used for continuous decoding of 
involutional codes. This constraint leads to a frame, that rigidity imposed on the system and also reduces the overall code rate. 

A more flexible decoding strategy is offered by modifying the algorithm. This modification is in such a way, that the 
SISO module operates on a fixed memory span and outputs the smoothed probability distributions after a given delay D. This 
new algorithm is called the sliding-window soft-input soft-output (SW-SISO) algorithm (and module). We propose two 
versions of the SW-SISO that differ in the way they overcome the problem of initializing the backward recursion without 

waiting for the entire sequence. From now on, we assume that the time index set AT is semi-infinite, i.e., K={] oo}, and that 

the initial state s 0 is known. 

2.4. 1 . First Version of the Sliding-Window SISO Algorithm ( SW-SISO 1 ^ 
The SW-SISO 1 algorithm comprises of the following steps: 

(1) Initialize Ao according to Equation (82). 

(2) Forward recursion at time A*: Compute the A k through the forward recursion of Equation (80). 

(3) Initialization of the backward recursion (time k > D ): 

Btg*(s) - A k (s) Vs (90) 

(4) Backward recursion: It is performed according to Equation (8 1 ) from iterations iW to i=D as: 
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&V(s) = 2 B i i:lli[s E (e)] P k [u(e);I] P k [c(e);J] (91) 

and 

ft-Dftl = ^ (92) 

(5) The probability distributions at time k -D are computed as 
5 P k .D(c;0) - He H c Z At-D-t I V s (e)J P k . D [u(e);I] B k -ols E (e)] (93) 

Pk.D(»:0) = He H c Z A k . D -i[s s (e)] P k . D [c(e);I] B k . D [s B (e)J (94) 

2.4.2. The Sec ond Simplified Version of the Sliding-Window SISQ Algorithm (SW-SISQ2^ 

A further simplification of the sliding- window SISO algorithm, which is similar to SW-SISOl except for the 
backward initial condition, that significantly reduces the memory requirements comprises of the following steps: 
10 ( 1 ) Initialize A 0 according to Equation (82). 

(2) Forward recursion at time k, k > D: Compute the A m. d through the forward recursion 

Ak-D(s) = Z At-D-i[s s (e)] P k . D [u(e);I] P k „ D [c(e).I] . k > D (95) 

(3) Initialization of the backward recursion (time k > D): 

TV 

15 (4) Backward recursion (time k > D): It is performed according to Equation (9 1 ) as before. 

(5) The probability distributions at time k - D are computed according to Equations (93) and (94) as before. 

2.4.3. Memory and Computational Complexity 
2.4.3.1.- Algorithm SW-SISOl . 

For a convolutional code with parameters (k 0 .no ) and number of states N , so that Mj = 2 ko and Mo = 2 m , 

20 the algorithm SW-SISOl requires storage of M *D values of A's and D(N / + No ) values of the input unconstrained 
probabilities P k (u; I) and P k (c; I). Moreover, to update the A's and B's for each time instant, it needs to perform 2 x// x N t 
multiplications and N additions of Jv> numbers. To output the set of probability distributions at each time instant, we need a 
D-times long backward recursion. Thus, overall the computational complexity requires the following: 2(D+l)*Nx N / 
multiplications and (D +1)* x (Ni-1) additions. 

25 2.4.3.2. Algorithm SW-SISQ2. 

This simplified version of the sliding-window SISO algorithm does not require the storage of the N*D values of A's, 
as they are updated with a delay of D steps. As a consequence, only N values of A's and D (Nt + No ) values of the input 
unconstrained probabilities P k (u: I) and P k (c; I) need to be stored. The computational complexity is the same as that for the 
previous version of the algorithm. However, since the initialization of the B recursion is less accurate, a larger value of D may 

30 be necessary. 

2.5. The Additive SISO Algorithm ( A-SISO^ 

The sliding-window SISO algorithms solve the problems of continuously updating the probability distributions, 
without requiring trellis terminations. Their computational complexity, however, is still high when compared to other 
suboptimal algorithms like SOVA. This is due mainly to the fact that they are multiplicative algorithms. We overcome this 

35 drawback by proposing the additive version of the SISO algorithm. Clearly, the same procedure can be applied to its two 
sliding-window versions, SW-SISOl and SW-SIS02. 
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To convert the previous SISO algorithm from multiplicative to additive form, we exploit the monotonicity of the 
logarithm function, and use for the quantities P(u;>).P(cr). A, and B their natural logarithms, according to the following 
definitions: 

n k (c;l) = log fP k (c;I)J 
n k (u;I) =» log [P k (u;I)J 
n k (c;0) = log [P k (c;0)J 
n k (u;0) - \o%[p k (u;0)] 
a k (s) = log [A k (s)J 
0 k (s) = log [B k (s)J 

With these definitions, the SISO algorithm defined by Equations (84) and (85) and Equations (80) and (81 ) becomes 
the following: At time Ar, the output probability distributions are computed as 

K k (c;0) = log Z e (a^] + ^W] + AW^ (97) 

n k (u;0) = log Z tfM^H + + ^l**M)l + /,„ (98) 

where the quantities Ok (•) and fi (') are obtained through the forward and backward recursions, respectively, as 
a* | 



*(S) = iOg Z tfW^H + + ^cieXJ]) 

P k (s) « log Z + + 

with initial values 

I -oo otherwise] 



k « 7 /j (99) 

* = n-J 0 (100) 



otherwise J 

The quantities /i c and /*„ are normalization constants needed to prevent excessive growth of the numerical values of 
the a's and f?s. 

The problem in the previous recursions comprises in the evaluation of the logarithm of a sum of exponential like (in 

general): 

<* = log Z e* j (101) 

To evaluate a in Equation (101), we can use two approximations, with increasing accuracy (and complexity). 
The first approximation is 



Z e* j « a M (102) 



a = log 
where we have defined 

clm = max { a, } , i = / L 

i 

This approximation assumes that 
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ccm > > ai . V/ «- 1 L 
It is almost optimal for medium-high signal-to-noise ratios and leads to performance degradations of the order of 0.5 
to 0.7 dB for very low signal-to-noise ratios. 

Using Equation (102), the recursions of Equations (99) and (100) become 

5 at (s) = ^max { ak-i[s s (e)] + x k \u(e) ; l) + nk \c(e) ; I ] j , k = / n (103) 

P k (s) = + \ u < e ) : 1 ] + / ] } . * - n-l 0 (104) 

and the rfs of Equations (97) and (98) become 

7t k (c;0) « tf maxJ ajw^fej] + ff* ; / ] + fi k \ s E (e) ] } + h c (105) 

= max { ajt./f^fe*] + n k [c(e); l \ + /? t MfeJ 1 ) + h u (106) 

1 0 When the accuracy of the previously proposed approximation is not sufficient, we can evaluate "a " in Equation ( 101 ) 

using the following recursive algorithm: 



a"> = a, 

a® = max { . „, } + log [ 1 * e " I ^" ■ " I ] . / = 2 L 

a = flW 

15 To evaluate a, the algorithm needs to perform (L - 1) times two kinds of operations: a comparison between two 

numbers to find the maximum, and the computation of 

log [ 1 + e ( ' A) ] A ^ 0 

The second operation can be implemented using a single-entry look-up table up to the desired accuracy. Therefore, a 

in Equation (101) can be written as a=aM+S(a lt a 2 . ... . aO=maxi* (a t /. The second term, S ( aj , a 2 aO> is called the 

20 correction term and can be computed using a look-up table, as discussed above. Now, if desired, max can be replaced by max* 
in Equations (103) through (106). 

Clearly, the additive form of the SISO algorithm can be applied to both versions of the sliding-window SISO 
algorithms described in the previous section, with straightforward modifications. 
2.6. Applications of the ASW-SISO Module 
25 Consider a PMCCC obtained using as constituent codes two equal rate 1/2 systematic, recursive, 16-state 

convolutional encoders with generating matrix 



ami'. '*?*?*? ' 



The interleaver length is N= 16,384. The overall PMCCC forms a very powerful code for possible use in applications 
requiring reliable operation at very low signal-to-noise ratios. 

30 The performance of the continuous iterative decoding algorithm, applied to the concatenated code, is obtained by 

simulation, using the ASW-SISO and the look-up table algorithms. It is shown in Figure 50, where we plot the bit-error 
probability as a function of the number of iterations of the decoding algorithm for various values of the bit signal-to-noise ratio, 
Ei/No- It can be seen that the decoding algorithm converges up to an error probability of 10* 5 , for signal-to-noise ratios of 0.2 dB 
with nine iterations. Moreover, convergence is guaranteed also at signal-to-noise ratios as low as 0.05 dB, which is 0.55 dB 

35 from the Shannon capacity limit. 
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As a second example, we construct the serial concatenation of two convolutionai codes (SMCCCs) using as an outer 
code the rate 1/2, 8-state nonrecursive encoder with generating matrix 

G(D) =[1 +D + D 3 . 1 + DJ 
and, as an inner code, the rate 1/2, 8-state recursive encoder with generating matrix 



The resulting SMCCC has rate 1/4. The interleaver length has been chosen to ensure a decoding delay in terms of input 
information bits equal to 16,384. 



the bit-error probability as a function of the number of iterations of the decoding algorithm for various values of the bit 
signal-to-noise ratio, Et/N 0 . It can be seen that the decoding algorithm converges up to an error probability of 10"*, for 
signal-to-noise ratios of 0.10 dB with nine iterations. Moreover, convergence also is guaranteed at signal-to-noise ratios as low 
as -0. 1 0 dB, which is 0.71 dB from the capacity limit 

As a third, and final, example, we compare the performance of a PMCCC and an SMCCC with the same rate and 
complexity. The concatenated code rate is 1/3, the CCs are four-state recursive encoders (rates 1/2 + 1/2 for the PMCCCs and 
rates 1/2 + 2/3 for the SMCCCs), and the decoding delays in terms of input bits are equal to 16,384. In Figure 52, we report the 
bit-error probability versus the signal-to-noise ratio for six and nine decoding iterations. As the curves show, the PMCCC 
outperforms the SMCCC for high values of the bit-error probabilities. Below IO* 5 (for nine iterations), the SMCCC behaves 
significandy better and does not present the "floor" behavior typical of PMCCCs. In particular, at 10* 6 , the SMCCC has an 
advantage of 0.5 dB with nine iterations. 
3. ADSL systems 

Figures 53, 54, 55 and 56 are models for facilitating accurate and concise DMT signal waveform descriptions. In the 
Figures 53, 54, 55 and 56 Z, is DMT sub-carrier i (defined in the frequency domain), and x n is the IDFT output sample 
(defined in the time domain). The DAC and analog processing block construct the continuous transmit voltage waveform 
corresponding to the discrete digital input samples. More precise specifications for these analog blocks arise indirectly from 
the analog transmit signal linearity and power spectral density specifications. The use of Figures 53, 54, 55 and 56 as a 
transmitter reference model allows all initialization signal waveforms to be described through the sequence of DMT symbols, 
{Z,}, required to produce that signal. Allowable differences in the characteristics of different digital to analog and analog 
processing blocks will produce somewhat different continuous-time voltage waveforms for the same initialization signal. 
3.1. ATU-C transmitter reference models 

ATM and STM are application options. ATU-C and ATU-R may be configured for either STM bit sync transport or 
ATM cell transport. 

3.1.1 ATU-C transmitter reference model for STM transport 

Figure 53 is a block diagram of an ADSL Transceiver Unit-Central office (ATU-C) transmitter showing the 
functional blocks and interfaces for the downstream transport of STM data. 

The basic STM transport mode is bit serial. The framing mode used determines if byte boundaries, if present at the 
V-C interface, shall be preserved. Outside the ASx/LSx serial interfaces data bytes are transmitted MSB first. AH serial 
processing in the ADSL frame (e.g., CRC, scrambling, etc.) shall, however, be performed LSB first, with the outside world 
MSB considered by the ADSL as LSB. As a result, the first incoming bit (outside world MSB) shall be the first processed bit 
inside the ADSL (ADSL LSB). ADSL equipment shall support at least bearer channels AS0 and LS0 downstream. Support of 
other bearer channels is optional. Two paths are shown between the Mux/Sync control and Tone ordering; the "fast" path 
provides low latency, the interleaved path provides very low error rate and greater latency. 



G(D) - 1 . 



I + D f D 3 
1 + D 



The performance of the concatenated code, obtained by simulation as before, is shown in Figure 51 , where we plot 
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An ADSL system supporting STM, shall be capable of operating in a dual latency mode for the downstream direction, 
in which user data is allocated to both paths (i.e. fast and interleaved). An ADSL system supporting STM, shall be capable of 
operating in a single latency mode for both the downstream and upstream directions, in which all user data is allocated to one 
path (i.e. fast or interleaved). An ADSL system supporting STM transport may be capable of operating in an optional dual 
latency mode for the upstream, in which user data is allocated to both paths (i.e. fast and interleaved). 
3. L2 ATU-C transmitter reference model for ATM transport 

Figure 54 is a block diagram of an ADSL Transceiver Unit-Central office (ATU-C) transmitter showing the 
functional blocks and interfaces that are referenced in ITU-T G. 992.1 Recommendation for the downstream transport of ATM 
data. 

Byte boundaries at the V-C interface shall be preserved in the ADSL data frame; Outside the ASx/LSx serial interfaces 
data bytes are transmitted MSB first. All serial processing in the ADSL frame (e.g., CRC, scrambling, etc.) shall, however, be 
performed LSB first, with the outside world MSB considered by the ADSL as LSB. The first incoming bit (outside world 
MSB), will be the first processed bit inside the ADSL (ADSL LSB). The CLP bit of the ATM cell header will be carried in the 
MSB of the ADSL frame byte (i.e., processed last); ADSL equipment shall support at least bearer channel ASO downstream). 
Two paths are shown between the Mux/Sync control and Tone ordering; the "fast" path provides low latency; the interleaved 
path provides very low error rate and greater latency. An ADSL system supporting ATM transport shall be capable of operating 
in a single latency mode, in which all user data is allocated to one path (i.e. fast or interleaved). An ADSL system supporting 
ATM transport may be capable of operating in an optional dual latency mode, in which user data is allocated to both paths (i.e. 
fast and interleaved). 
3.2. ATU-R transmitter reference models 

ATM and STM are application options. ATU-C and ATU-R may be configured for either STM bit sync transport or 
ATM cell transport 

3.2. 1 ATU-R transmitter reference model for STM transport 

Figure 55 show a block diagram of an ATU-R transmitter showing the functional blocks and interfaces that are 
referenced in this Recommendation for the upstream transport of STM. 

The basic STM transport mode is bit serial. The framing mode used determines if byte boundaries, if present at the 
V-C interface, shall be preserved. Outside the LSx serial interfaces data bytes are MSB transmitted first. All serial processing 
in the ADSL frame (e.g., CRC, scrambling, etc.) shall, however, be performed LSB first, with the outside world MSB 
considered by the ADSL as LSB. As a result, the first incoming bit (outside world MSB) will be the first processed bit inside 
the ADSL (ADSL LSB). ADSL equipment shall support at least bearer channel LSO upstream. Two paths are shown between 
the Mux/Sync control and Tone ordering; the "fast" path provides low latency; the interleaved path provides very low error rate 
and greater latency. An ADSL system supporting STM shall be capable of operating in a dual latency mode for the downstream 
direction, in which user data is allocated to both paths (i.e. fast and interleaved). An ADSL system supporting STM shall be 
capable of operating in a single latency mode for both the downstream and upstream directions, in which all user data is 
allocated to one path (i.e. fast or interleaved). An ADSL system supporting STM transport may be capable of operating in an 
optional dual latency mode for the upstream, in which user data is allocated to both paths (i.e. fast and interleaved). 

3.2.2 ATU-R transmitter reference model for ATM transport 

Figure 56 show a block diagram of an ATU-R transmitter showing the functional blocks and interfaces that are 
referenced in this Recommendation for the upstream transport of ATM data. 

Byte boundaries at the T-R interlace shall be preserved in the ADSL data frame. Outside the LSx serial interfaces 
data bytes are transmitted MSB first in accordance with ITU-T Recommendations 1.361 and 1.432. All serial processing in the 
ADSL frame (e.g. CRC, scrambling, etc.) shall, however, be performed LSB first, with the outside world MSB considered by 
the ADSL as LSB. As a result, the first incoming bit (outside world MSB) will be the first processed bit inside the ADSL 
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(ADSL LSB), and the CLP bit of the ATM cell header will be carried in the MSB of the ADSL frame byte (i.e., processed last). 
ADSL equipment shall support at least bearer channel LSO upstream. Two paths are shown between the Mux/Sync control and 
Tone ordering; the "fast** path provides low latency, the interleaved path provides very low error rate and greater latency. An 
ADSL system supporting ATM transport shall be capable of operating in a single latency mode, in which all user data is 
5 allocated to one path (i.e. fast or interleaved). An ADSL system supporting ATM transport may be capable of operating in an 
optional dual latency mode, in which user data is allocated to both paths (i.e. fast and interleaved). 
3.3 Transport Capacity. 

An ADSL system may transport up to seven user data streams on seven bearer channels simultaneously up to four 
independent downstream simplex bearers (unidirectional from the network operator (i.e. V-C interface) to the CI (i.e. T-R 
10 interface)) 

An ADSL system may transport up to three duplex bearers (bi-<iirectional between the network operator and the CI). 

The three duplex bearers may alternatively be configured as independent unidirectional simplex bearers, and the 
rates of the bearers in the two directions (network operator toward CI and vice versa) do not need to match. 

All bearer channel data rates shall be programmable in any combination of integer multiples of 32 kbit/s. 
1 5 The ADSL data multiplexing format is flexible enough to allow other transport data rates, such as channelizations 

based on existing 1.544 Mbit/s, but the support of these data rates (non-integer multiples of 32 kbit/s) will be limited by the 
ADSL system's available capacity for synchronization. 

The maximum net data rate transport capacity of an ADSL system will depend on the characteristics of the loop on 
which the system is deployed, and on certain configurable options that affect overhead The ADSL bearer channel rates shall be 
20 configured during the initialization and training procedure. 

The transport capacity of an ADSL system per se is defined only as that of the bearer channels. When, however, an 
ADSL system is installed on a line that also carries POTS or ISDN signals the overall capacity is that of POTS or ISDN plus 
ADSL 

A distinction is made between the transport of synchronous (STM) and asynchronous (ATM) data. An ATU-x shall 
25 be configured to support STM transmission or ATM transmission. Bearer channels configured to transport STM data can also 
be configured to carry ATM data. ADSL equipment may be capable of simultaneously supporting both ATM and STM 
transport. 

If an ATU-x supports a particular bearer channel it shall support it through both the fast and interleaved paths. 
In addition, an ADSL system may transport a Network Timing Reference (NTR). 
30 3.3.1. Transport of STM data 

ADSL systems transporting STM shall support the simplex bearer channel ASO and the duplex bearer channel LSO 
downstream. Bearer channels ASO, LSO, and any other bearer channels supported shall be independently allocable to a 
particular latency path as selected by the ATU-C at start-up. The system shall support dual-latency downstream. 

ADSL systems transporting STM shall support the duplex bearer channel LSO upstream using a single latency path. 
35 Bearer channel ASO shall support the transport of data at all integer multiples of 32 kbit/s from 32 kbit/s to 6 144 kbit/s. 

Bearer channel LSO shall support 16 kbit/s and all integer multiples of 32 kbit/s from 32 kbit/s to 640 kbit/s. 

When AS1, AS2, AS3, LSI and LS2 are provided, they shall support the range of integer multiples of 32 kbit/s shown 
in Table 4. Support for data rates based on non-integer multiples of 32 kbit/s is also optional. 
Table 4 shows the required 32 kbit/s integer multiples for transport of STM. 
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Table 4. Required 32 kbit/s integer multiples for transport of STM 



6Bearer channel 


Lowest Required Integer 
multiple 


Largest Required 
Integer Multiple 


Corresponding Highest 
Required Data Rate 
(kbit/s) 






192 


6144 


AS1 


j 


144 


40UO 


AS2 




96 


3072 


AS3 




48 


1536 


LSO 




20 


640 


LSI 




20 


640 


LS2 




20 


640 



Table 5 illustrates the data rate terminology and definitions used for STM transport. 

Table 5. Data Rate Terminology for STM transport 



Data Rate 


Equation (kbits/s) 


Reference Point 


STMdata rate = '*Net data rate" 


KBi.Bf)X32 
(NOTE) 


ASx + LSx 


"Net data rate" + Frame overhead rate = "Aggregate data 

rate" 


S(K^Kf)X32 


A 


"Aggregate data + RS Coding overhead = "Total data rate" 
rate" rate 


S(N L N F )X32 


B 


"Total data rate" + Trellis Coding = Line rate 

overhead rate 


Ib,X4 


U 


NOTE - Net data rate increase by 16 kbit/s if a 16 kbit/s "C"-channel is used. 



3.3.2. Transport of ATM data 

An ADSL system transporting ATM shall support the single latency mode at all integer multiples of 32kbit/s up to 
6. 144 Mbit/s downstream and up to 640 kbit/s upstream. For single latency, ATM data shall be mapped to bearer channel AS0 
in the downstream direction and to bearer channel LSO in the upstream direction. 

The need for dual latency for ATM services depends on the service/application profile, and is under study by the ITU. 
One of three different "latency classes'* may be used: Single latency, not necessarily the same for each direction of 
transmission, Dual latency downstream, single latency upstream, Dual latency both upstream and downstream. 

ADSL systems transporting ATM shall support bearer channel AS0 downstream and bearer channel LSO upstream, 
with each of these bearer channels independently allocable to a particular latency path as selected by the ATU-C at start-up. 
Therefore, support of dual latency is optional for both downstream and upstream. 

If downstream ATM data are transmitted through a single latency path (i.e., 'fast* only or •interleaved* only), only bearer 
channel AS0 shall be used, and it shall be allocated to the appropriate latency path. If downstream ATM data are transmitted 
through both latency paths (i.e., last* and 'interleaved*), only bearer channels AS0 and AS1 shall be used, and they shall be 
allocated to different latency paths. 

Similarly, if upstream ATM data are transmitted through a single latency path (i.e., 'fast* only or interleaved' only), only 
bearer channel LSO shall be used and it shall be allocated to the appropriate latency path. The choice of the fast or interleaved 
path may be made independently of the choice for the downstream data. If upstream ATM data are transmitted through both 
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latency paths (i.e., 'fast* and 'interleaved'), only bearer channels LSO and LSI shall be used and they shall be allocated to 
different latency paths. 

Bearer channel ASO shall support the transport of data at all integer multiples of 32 kbit/s from 32 kbit/s to 6144 kbit/s. 
Bearer channel LSO shall support all integer multiples of 32 kbit/s from 32 kbit/s to 640 kbit/s. Support for data rates based on 
non-integer multiples of 32 kbit/s is also optional. 

When AS1 and LSI are provided, they shall support the range of integer multiples of 32 kbit/s shown in Table 4. 
Data rates based on non-integer multiples of 32 kbit/s is optional. 

Bearer channels AS2, AS3 and LS2 shall not be provided for an ATM based ATU-x. 

Table 6 illustrates the data rate terminology and definitions used for ATM transport. 



Table 6- D ata Rate Terminology for ATM transport 



Data Rate 


Equation kbits/s) 


Ref Point 


53 x 8 x ATM cell rate 


"Net data rate" 


L(Bi,B F )X32 


ASx + LSx 


"Net data rate" 


+ Frame overhead rate ' 


"Aggregate data 
rate" 




L(Ki.K F )X32 


A 


"Aggregate data rate" 


+ RS Coding overhead rate = 


"Total data rate" 


£(N t .N F )X32 


B 


"Total data rate" 


+ Trellis Coding overhead = 
rate 


Line rate 




Eb,X4 


U 



3.3.3. ADSL system overheads and total bit rates 

The total bit rate transmitted by the ADSL system when operating in an optional reduced-overhead framing mode 
shall include capacity for the data rate transmitted in the ADSL bearer channels and ADSL system overhead (which includes: 
an ADSL embedded operations channel, EOC; an ADSL overhead control channel, AOC; CRC check bytes; fixed indicator bits 
for OAM; FEC redundancy bytes). When operating in the full-overhead mode the total bit rate shall also include capacity for 
the synchronization control bytes and capacity for bearer channel synchronization control. 

The internal overhead channels and their rates are shown in Table 7. 
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Table 7. Internal overhead channel functions and rates 





Downstream rate (kbit/s) 
minimum /maximum 


Upstream rate (kbit/s) 
minimum / maximum 




Number of ASx 
bearer channels 
> 1 


Number of ASx 
bearer channels 
= 1 


Number of LSx 
bearer channels 
> 1 


1 Number of LSx 
I bearer channels 
= 1 


Synchronization control, 
CRCandAOC; 
interleaved buffer 


32/32 


32/32 


32/32 


32/32 


Synchronization control, 
CRC, EOC and indicator 
bits; 

fast buffer 


32/32 


32/32 


32/32 


32/32 


Total for reduced 
overhead framing 


32/64 
(NOTE 2) 


32/64 
(NOTE 2) 


32/64 
(NOTE 2) 


32/64 
(NOTE 2) 


Synchronization capacity 
(shared among all bearer 
channels) 


64/128 
(NOTE 3) 


64/96 
(NOTE 3) 


32/64 
(NOTE 3) 


32/32 
(NOTE 3) 


Total 

(NOTE 1) 


128/ 192 


128/ 160 


96 / 128 


96/96 


NUIli I - Vhe overhead required for FEC is not shown in this table. 

NOTE 2 - With the reduced overhead framing modes, a 32 kbit/s ADSL system overhead is present in each buffer type. 

However, when all ASx and LSx are allocated to one buffer type, synchronization control, CRC, EOC, AOC 
and indicator bits may be carried in a single 32 kbit/s ADSL system overhead present in the buffer type used. 
With full overhead framing, a 32 kbit/s ADSL system overhead is always present in each buffer type. 

NOTE 3 - The shared synchronization capacity includes 32 kbit/s shared among LSx within the interleave buffer, 32 
kbit/s shared among LSx within the fast buffer, 32 kbit/s shared among ASx within the interleave buffer, and 
32 kbit/s shared among ASx within the fast buffer. The maximum rate occurs when at least one ASx is 
allocated to each type of buffer, the minimum rate occurs when all ASx and LSx are allocated to one buffer 
type. 



3.4. ATU-C Functional Characteristics. 

An ATU-C may support STM transmission or ATM transmission or both. Framing modes that shall be supported, 
depend upon the ATU-C being configured for either STM or ATM transport. If framing mode k is supported, then modes k-1 , 
0 shall also be supported.. 

During initialization, the ATU-C and ATU-R shall indicate a framing mode number 0, 1, 2 or 3, which they intend to 
use. The lowest indicated framing mode shall be used. 

Using framing mode 0 ensure than an STM based ATU-x with an external ATM TC will interoperate with an ATM 
based ATU-x. Additional modes of interoperation are possible depending upon optional features provided in either ATU-x. 

An ATU-C may provide a Network Timing Reference (NTR). This operation shall be independent of any clocking 
that is internal to the ADSL system. 
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3.4.1. STM Transmission Protocol Specific functionalities 

3.4.1.1 . ATU-C input and output V interfaces for STM transport 

The functional data interfaces at the ATU-C for STM transport are shown in Figure 57. . Input interfaces for the high- 
speed downstream simplex bearer channels are designated ASO through AS3; input/output interfaces for the duplex bearer 
channels are designated LSO through LS2. There shall also be a duplex interface for operations, administration, maintenance 
(OAM) and control of the ADSL system. 

3.4.1.2. Downstream simplex channels 

Four data input interfaces are defined at the ATU-C for the high-speed downstream simplex channels: ASO, AS1, 
AS2 and AS3 (ASx in general). 

3.4. 1 .3. Down stream/upstream duplex channels 

Three input and output data interfaces are defined at the ATU-C for the duplex channels supported by the ADSL 
system; LSO, LSI, and LS2 (LSx in general). LSO is also known as the "C" or control channel. It carries the signaling 
associated with the ASx bearer channels and it may also carry some or all of the signaling associated with the other duplex 
bearer channels. 

3.4. 1 .4. Pavload transfer delay 

The one-way transfer delay for payload bits in all bearers (simplex and duplex) from the V reference point at central 
office end (V-C) to the T reference point at remote end (T-R) for channels assigned to the fast buffer shall be no more than 2 
ms. For channels assigned to the interleave buffer it shall be no more than (4 + (S-l)/4 +SxD/4) ms. The same requirement 
applies in the opposite direction, from the T-R reference point to the V-C reference point. 

3.4. 1 .5. Framing Structure for STM transport 

An ATU-C configured for STM transport shall support the full overhead framing structure O.The support of full 
overhead framing structure 1 and the reduced overhead framing structures 2 and 3 is optional. Preservation of V-C interface 
byte boundaries (if present) at the U-C interface may be supported for any of the U-C interface framing structures.An ATU-C 
configured for STM transport may support insertion of a Network Timing Reference (NTR). 
3.4.2. ATM Transmis sion Protocol Specific functionalities 
3.4.2.1. ATU-C input and output V interface for ATM transport 

The functional data interfaces at the ATU-C for ATM is shown in Figure 58. The ATM channel ATMO shall always 
be provided, the channel ATM1 may be provided for support of dual latency mode. Each channel operates as an interface to a 
physical layer pipe. When operating in dual latency mode, no fixed allocation between the ATM channels 0 and 1 on one hand 
and transport of 'fast' and 'interleaved' data on the other hand is assumed. This relationship is configured inside the ATU-C. 

Flow control functionality shall be available on the V reference point to allow the ATU-C (i.e. the physical layer) to 
control the cell flow to and from the ATM layer. This functionality is represented by Tx_CeU_Handshake and 
Rx_Cell_Handshake. A cell may be transferred from ATM to PHY layer only after the ATU-C has activated the 
Tx.CelLHandshake. Similarly a cell may be transferred from the PHY layer to the ATM layer only after the 
Rx_CelI Jlandshake. This functionality is important to avoid cell overflow or underflow in the ATU-C and ATM layers. 

There shall also be a duplex interface for operations, administration, maintenance (OAM) and control of the ADSL 

system. 

3.4.2.2 Pavload transfer delay 

The one-way transfer delay (excluding cell specific functionalities) for payload bits in all bearers (simplex and 
duplex) from the V reference point at central office end (V-C) to the T reference point at remote end (T-R) for channels 
assigned to the fast buffer shall be no more than 2 ms. 

For channels assigned to the interleave buffer it shall be no more than (4 + (S-1J/4 +Sx£>/4) ms. The same 
requirement applies in the opposite direction, from the T-R reference point to the V-C reference point. 
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3.4.2.3. ATM Cell specific functionalities 

3.4.2.3.1. Idle Cell Insertion 

Idle cells shall be inserted in the transmitter direction for cell rate de-coupling. Idle cells are identified by the 
standardized pattern for the cell header given in ITU-T Recommendation 1.432. 

3.4.2.3.2. Header Error Control (HEC) Generation. 

The HEC byte shall be generated in the transmit direction as described in ITU-T Recommendation 1.432, including 
the recommended modulo 2 addition (XOR) of the pattern OlOlOlOh to the HEC bits. The generator polynomial coefficient set 
used and the HEC sequence generation procedure shall be in accordance with ITU-T Recommendation L432. 

3.4.2.3.3. Cell pavload scrambling. 

Scrambling of the cell payload field shall be used in the transmit direction to improve the security and robustness of 
the HEC cell delineation mechanism. In addition, it randomizes the data in the information field, for possible improvement of 
the transmission performance. The self synchronizing scrambler polynomial X 43 +l and procedures defined in ITU-T 
Recommendation 1.432 shall be implemented. 

3.4.2.3.4. Bit timing and ordering 

When interfacing ATM data bytes to the ASO or AS1 bearer channel, the most significant bit (MSB) shall be sent 
first. The ASO or AS1 bearer channel data rates shall be integer multiples 32 kbit/s, with bit timing synchronous with the 
ADSL downstream timing base. 

3.4.2.3.5 Cell Delineation. 

The cell delineation function permits the identification of cell boundaries in the payload. It uses the HEC field in the 
cell header. Cell delineation shall be performed using a coding law checking the HEC field in the cell header according to the 
algorithm described in ITU-T Recommendation 1.432. The ATM cell delineation state machine is shown in Figure 59. 

In the HUNT state, the delineation process is performed by checking bit by bit for the correct HEC. Once such an 
agreement is found, it is assumed that one header has been found, and the method enters the PRESYNC state. When byte 
boundaries are available within the receiving Physical Layer prior to cell delineation as with the framing modes 1, 2 and 3, the 
cell delineation process may be performed byte by byte. In the PRESYNC state, the delineation process is performed by 
checking cell by cell for the correct HEC. The process repeats until the correct HEC has been confirmed DELTA times 
consecutively. If an incorrect HEC is found, the process returns to the HUNT state. In the SYNC state the cell delineation will 
be assumed to be lost if an incorx^t HEC is obtained ALPHA times consecutively. (With reference to ITU-T Recommendation 
1.432, no recommendation is made for the values of ALPHA and DELTA as the choice of these values is not considered to effect 
interoperability. However, it should be noted that the use of the values suggested in ITU-T Recommendation 1.432 (ALPHA=7 y 
DELTA=6) may be inappropriate due to the particular transmission characteristics of ADSL). 

3.4.2.3.6 Header Error Control Verification 

The HEC covers the entire cell header. The code used for this function is capable of either single bit error correction 
or multiple bit error detection. Error detection shall be implemented as defined in ITU-T Recommendation 1.432 with the 
exception that any HEC error shall be considered as a multiple bit error, and therefore, HEC error correction shall not be 
performed. 

3.4.2.4 Framing Structure for ATM transport 

An ATU-C configured for ATM transport shall support the full overhead framing structures 0 and 1 . The support of 
reduced overhead framing structures 2 and 3 is optional. The ATU-C transmitter shall preserve V-C interlace byte boundaries 
(explicitly present or implied by ATM cell boundaries) at the U-C interface, independent of the U-C interface framing 
structure. 

To ensure training structure 0 interoperability between an ATM ATU-C and an ATM cell TC plus an STM ATU-R 
(i.e., ATM over STM), transporting ATM cells and not preserving T-R byte boundaries at the U-R interface shall indicate 
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during initialization that frame structure 0 is the highest frame structure supported. An STM ATU-R transporting ATM cells 
and preserving T-R byte boundaries at the U-R interface shall indicate during initialization that frame structure 0, 1, 2 or 3 is 
the highest frame structure supported. An ATM ATU-C receiver operating in framing structure 0 can not assume that the 
ATU-R transmitter will preserve T-R interface byte boundaries at the U-R interface and shall therefore perform the cell 
delineation bit-by-bit 

An ATU-C configured for ATM transport may support insertion of a Network Timing Reference (NTR). 
3.4.3 Network timing reference fNTR) 

3.4.3.1 Need for NTR 

Some services require that a reference clock be available in the higher layers of the protocol stack (i.e. above the 
physical layer); this is used to guarantee end-to-end synchronization of transmit and receive sides. Examples are Voice and 
Telephony Over ATM (VTOA) and Desktop Video Conferencing (DVC). 

To support the distribution of a timing reference over the network, the ADSL system may transport an 8 kHz timing 
marker as NTR. This 8 kHz timing marker may be used for voice/video playback at the decoder (D/A converter) in DVC and 
VTOA applications. The 8 kHz timing marker is input to the ATU-C as part of the interface at the V-C reference point. 

3.4.3.2 Transport of the NTR 

The intention of the NTR transport mechanism is that the ATU-C provides timing information at the U-C reference 
point to enable the ATU-R to deliver to the T-R reference point timing information that has a timing accuracy corresponding to 
the accuracy of the clock provided to the V-C reference point. If provided, the NTR shall be inserted in the U-C framing 
structure as follows: 

a) The ATU-C may generate an 8 kHz local timing reference (LTR) by dividing its sampling clock by the appropriate 
integer (276 if 2.208 MHz is used); 

b) It shall transmit the change in phase offset between the input NTR and LTR (measured In cycles of the 2.208 MHz 
clock, that is units of approximately 452 ns) from the previous superframe to the present one. This shall be encoded 
into four bits ntr3 - ntrO (with ntr3 the MSB), representing a signed integer in the -8 to +7 range in 2 ^-complement 
notation. The bits ntr3-ntr0 shall be carried in the indicator bits 23 (ntr3) to 20 (ntrO); see Table 9. 

c) A positive value of the change of phase offset, D 2 f, shall indicate that the LTR is higher In frequency than the 
NTR 

d) Alternatively, the ATU-C may choose to lock its downstream sampling clock (2.208 MHz) to 276 times the NTR 
frequency; in that case it shall encode A 2 f to zero. 

The NTR, as specified by ANSI Standard Tl. 101, has a maximum frequency variation of ±32 ppm. The LTR has a 
maximum frequency variation of ±50 ppm. The maximum mismatch is therefore ±82 ppm. This would result in an average 
change of phase ofTset of approximately ± 3.5 clock cycles over one 17 ms superframe, which can be mapped into 4 overhead 
bits. 

One method that the ATU-C may use to measure this change of phase offset is shown in Figure 60. 
3.4.4 Framing 

This subclause specifies framing of the downstream signal (ATU-C transmitter). Two types of framing are defined: 
full overhead and reduced overhead. Furthermore, two versions of full overhead and two versions of reduced overhead are 
defined. The four resulting framing modes are defined in Table 8, and shall be referred to as framing modes 0, 1 , 2 and 3. 
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Table 8- Definition of framing modes 



Framing structure 


Description 


0 


Full overhead framing with asynchronous bit-to-modem timing 
(i.e. enabled synchronization control mechanism) 


1 


Full overhead framing with synchronous bit-to-modem timing 
(i.e. disabled synchronization control mechanism) 


2 


Reduced overhead framing with separate fast and sync byte in fast and interleaved latency 
buffer respectively (i.e. 64 kbit/s framing overhead) 


3 


Reduced overhead framing with merged fast and sync byte, using either the fast or the 
interleaved latency buffer (i.e. 32 kbit/s framing overhead) 



Requirements for framing modes to be supported, depend upon the ATU-C being configured for either STM or ATM transport. 
The ATU-C shall indicate during initialization the highest framing structure number it supports. If the ATU-C indicates it 
supports framing structure k, it shall also support all framing structures Jt-1 to 0. If the ATU-R indicates a lower framing 
structure number during initialization, the ATU-C shall faU back to the framing structure number indicated by the ATU-R. 
Outside the ASx/LSx serial interfaces data bytes are transmitted MSB first in accordance with ITU-T Recommendations G.703, 
G.709, 1.361, and 1.432. All serial processing in the ADSL frame (e.g., CRC, scrambling, etc.) shall, however, be performed 
LSB first, with the outside world MSB considered by the ADSL as LSB. As a result, the first incoming bit (outside world 
MSB) will be the first processed bit inside the ADSL (ADSL LSB). 
3.4.4. 1 Data symbols 

Figures 53 and 54 show functional block diagrams of the ATU-C transmitter with reference points for data framing. 
Up to four downstream simplex data channels and up to three duplex data channels shall be synchronized to the 4 kHz ADSL 
DMT frame rate, and multiplexed into two separate data buffers (fast and interleaved). A cyclic redundancy check (CRC), 
scrambling, and forward error correction (FEC) coding shall be applied to the contents of each bufTer separately, and the data 
from the interleaved buffer shall then be passed through an interleaving function. The two data streams shall then be tone 
ordered, and combined into a data symbol that is input to the constellation encoder. After constellation encoding the data shall 
be modulated to produce an analog signal for transmission across the customer loop. 

A bit-level framing pattern shall not be inserted into the data symbols of the frame or superframe structure. DMT 
frame (i.e. symbol) boundaries are delineated by the cyclic prefix inserted by the modulator. Superframe boundaries are 
determined by the synchronization symbol and shall also be inserted by the modulator, and which carries no user data. 

Because of the addition of FEC redundancy bytes and data interleaving, the data frames (i.e. bit-level data prior to 
constellation encoding) have different structural appearance at the three reference points through the transmitter. As shown in 
Figures 53 and 54, the reference points for which data framing will be described in the following subclauses is: 

a) A (Mux data frame): the multiplexed, synchronized data after the CRC has been inserted 

b) B (FEC output data frame): the data frame generated at the output of the FEC encoder at the DMT symbol rate, 
where an FEC block may span more than one DMT symbol period 

c) C (constellation encoder input data frame): the data frame presented to the constellation coder. 
3.4.4. 1 . 1 Superframe structure 

ADSL uses the superframe structure shown in Figure 6 1 . Each superframe is composed of 68 data frames, numbered 
from 0 to 67, which are encoded and modulated into DMT symbols, followed by a synchronization symbol, which carries no 
user or overhead bit-level data and is inserted by the modulator to establish superframe boundaries. From the bit-level and 
user data perspective, the DMT symbol rate is 4000 baud (period = 250 us), but in order to allow for the insertion of the 
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10 



15 



20 



synchronization symbol the transmitted DMT symbol rate is 69/68*4000 baud. Each data frame within the supertrame 
contains data from the fast buffer and the interleaved buffer. During each ADSL superframe, eight bits shall be reserved for the 
CRC on the fast data buffer (crcO-crc7), and 24 indicator bits (ib0-ib23) shall be assigned for QAM functions. As shown in 
Figure 62, the synchronizaton byte of the fast data buffer ("fast byte") carries the CRC check bits in frame 0 and the indicator 
bits in frames 1, 34, and 35. The fast byte in other frames is assigned in even-/odd-frame pairs to either the EOC or to 
synchronization control of the bearer channels assigned to the fast buffer. 

Bit 0 of the fast byte in an even-numbered frame (other than frames 0 and 34) and bit 0 of the fast byte of the odd- 
numbered frame immediately following shall be set to "0" to indicate these frames carry a synchronization control information. 
When they are not required for synchronization control, CRC, or indicator bits, the fast bytes of two successive ADSL frames, 
beginning with an even-numbered frame, may contain indications of "no synchronization action" or alternatively, they may be 
used to transmit one EOC message, consisting of 13 bits. The indicator bits are defined in Table 9. Bit 0 of the fast byte in an 
even-numbered frame (other than frames 0 and 34) and bit 0 of the fast byte of the odd-numbered frame immediately following 
shall be set to M" to indicate these frames carry a 13-bit EOC message plus one additional bit, rl. The rl bit is reserved for 
future use and shall be set to 1 . 

Table 9 - Definition of indicator bits. ATU-C transmitter (fast data buffer, downstream direction! 



Indicator bit 


Definition (see NOTE) 


ibO - ib7 


reserved for future use 


ibS 


FEBE-I 


ib9 


FECC-I 


iblO 


FEBE-F 


ibll 


FECC-F 


ibl2 


LOS 


ibl3 


RDI 


ibl4 


NCD-I (used for ATM only, shall be set to 1 for STM) 


ibl5 


NCD-F (used for ATM only, shall be set to 1 for STM) 


lb 16 


HEC-I (used for ATM only, shall be set to 1 for STM) 


ibl7 


HEC-F (used for ATM only, shall be set to 1 for STM) 


iblS- 19 


reserved for future use 


ib20-23 


N l KO - 3 (if NTR is not transported, ib20-23 shall be set to 1 - 
they are active low) 


NO IE - because all indicator bits are defined as active low, reserved bits shall be set to 1. 



Eight bits per ADSL supertrame shall be used for the CRC on the interleaved data buffer (crcO - crc7). As shown in 
Figure 63 and Figure 65, the synchronization byte of the interleaved data buffer ("sync byte") carries the CRC check bits for 
the previous supertrame in frame 0. In all other frames (1 through 67), the sync byte shall be used for synchronization control 
of the bearer channels assigned to the interleaved data buffer or used to carry an ADSL overhead control (AOC) channel. In 
the full overhead mode, when any bearer channel appears in the interleave buffer, then the AOC data shall be carried in the 
LEX byte, and the sync byte shall designate when the LEX byte contains AOC data and when it contains data bytes from the 
bearer channel. When no bearer channels are allocated in the interleaved data buffer (i.e., all BrfASx) = Bj(LSx) = 0\ the sync 
byte shall cam' the AOC data directly. 
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3.4.4. 1 .2 Frame structure (with fall overhead > 

Each data frame shall be encoded into a DMT symbol. As is shown in Figure 61, each fame is composed of a fast 
data buffer and an interleaved data buffer, and the frame structure has a different appearance at each of the reference points (A, 
B, and C). The bytes of the fast data buffer shall be clocked into the constellation encoder first, followed by the bytes of the 
interleaved data buffer. Bytes are clocked least significant bit first 

Each bearer channel shall be assigned to either the fast or the interleaved buffer during initialization, and a pair of 
bytes, [Bf.Bjl transmitted for each bearer channel, where Bp and Bj designate the number of bytes allocated to the fast and 
interleaved buffers, respectively. 

The seven [BpBj] pairs to specify the downstream bearer channel rates are: Bp(ASx). Bj(ASx) for X = 0, 1, 2 and 3, 
for the downstream simplex channels; BptLSx). B/(LSx) for X = 0, 1 and 2, for the (downstream transport of the) duplex 
channels. 

The rules for allocation are as follow: 

• For any bearer channel, X, (except the 16 kbit/s C channel option) either BpQC) = the number of bytes per frame 
of the fast buffer and Bj (X) ~ 0. or BflX) - 0 and Bj(X) = the number of bytes per frame of the interleaved 
buffer. 

• For the 16 kbit/s C channel option, Bp(LS0) = 255 (111 1111 Ij and B/(LS0) =0, or BtfLSO) - 0 and Bi(LS0) = 
255. 

3.4.4.1.2.1 Fast data buffer (with fall overheads 

The frame structure of the fast data buffer shall be as shown in Figure 64, for reference points A and B, which are 
defined in Figure 53 and 54. 

The following shall hold for the parameters shown in Figure 64: 
CpiLSO) = 0 ifBp(LS0) = 255 (llllUllj) 

= Bp(LS0) otherwise 
where R F = number of FEC redundancy bytes, and 

3 2 

K F =/ + z] BpfASO+AF+CFOSO)*^* Bp(LSj) + Lp 
i=o J= i 



where 



Ap = 0 if**T BpfASi) = 0 fori =0-3 
= / otherwise 



and 



Lf = 0 i/B/ASi) = Ofor i=0-3 and Bj(LSj) = Ofor j=0-2 
= 1 otherwise (including BpfLSO) = 255) 

At reference point A (Mux data frame) in Figure 53 and Figure 54 the fast buffer snail always contain at least the fast 
byte. This is followed by BtfASO) bytes of channel AS0, then BpfASl) bytes of channel AS1. Bp(AS2) bytes of channel AS2 
and Bf(AS3) bytes of channel AS3. Next come the bytes for any duplex (LSx) channels allocated to the fast buffer. If any 
BtfASx) is non-zero, then both an AEX and a LEX byte follow the bytes of the last LSx channel, and if any BrfLSx) is non-zero, 
the LEX byte shall be included. 
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When BpfLSO) = 255, no bytes are included for the LSO channel. Instead, the 16 kbit/s C channel shall be 
transported in every other LEX byte on average, using the sync byte to denote when to add the LEX byte to the LSO bearer 
channel. 

Rp FEC redundancy bytes shall be added to the mux data frame (reference point A) to produce the FEC output data 
5 frame (reference point B), where Rp is given in the options used during initialization. 

Because the data from the fast buffer is not interleaved, the constellation encoder input data frame (reference point C) 
is identical to the FEC output data frame (reference point B). 
3.4.4.1.2.2. Interleaved data buffer (with full overheads 

The frame structure of the interleaved data buffer is shown in Figure 65 for reference points A and B, which are 
1 0 defined in Figure 53 and 54. 

The following shall hold for the parameters shown in Figure 65 

Cf(LS0)= 0 ifBj(LS0) = 255 (111 11 111$ 

= Bj(LS0) otherwise 
Nj ^(SxKi + RrJ/S, 

1 5 where Rj = number of FEC redundancy bytes and S = number of DMT symbols per FEC codeword. 

3 2 

K? = 1 + 2 B l( ASi > + A f +Cj(LS0) + ]T B f (LSj) + Lj 



1=0 7=1 



where 



A I = 0 B I< ASi > = 0 

i-0 

- 1 otherwise 



20 and 



Lj =0 ifB } (ASi) =0 for i =0-3 and Bi(LSj) = Ofor J=0-2 

= / otherwise (including Bi(LS0) = 255) 
At reference point A, the Mux data frame, the interleaved data buffer shall always contain at least the sync byte. The 
rest of the buffer shall be built in the same manner as the fast buffer, substituting B\ in place of Bp. The length of each mux 
25 data frame is Kj bytes, as defined in Figure 65. 

The FEC coder shall take in S mux data frames and append /?j FEC redundancy bytes to produce the FEC codeword 
of length Nfec = S * A'j + /?j bytes. The FEC output data frames shall contain jVj = Nfec IS bytes, where A/j is an integer. 
When S > 1, then for the S frames in an FEC codeword, the FEC output Data Frame (reference point B) shall partially overlap 
two mux data frames for all except the last frame, which shall contain the /?j FEC redundancy bytes. 
30 The FEC output data frames are interleaved to a specified interleave depth. The interleaving process delays each 

byte of a given FEC output data frame a different amount, so that the constellation encoder input data frames will contain bytes 
from many different FEC data frames. At reference point A in the transmitter, mux data frame 0 of the interleaved data buffer 
is aligned with the ADSL superframe and mux data frame 0 of the fast data butler (this is not true at reference point C). At the 
receiver, the interleaved data buffer will be delayed by (S ' interleave depth ' 250) ms with respect to the fast data buffer, and 
35 data frame 0 (containing the CRC bits for the interleaved data buffer) will appear a fixed number of frames after the beginning 
of the receiver superframe. 
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3.4.4. 1 .3 Cyclic redundancy check (CRC) 

Two cyclic redundancy checks (CRCs)-one for the fast data buffer and one for the interleaved data buffer-shall be 
generated for each superframe and transmitted in the first frame of the following superframe. Eight bits per buffer type (fast or 
interleaved) per superframe allocated to the CRC check bits. These bits are computed from the k message bits using the 
equation: 

crc(D) = K4(D) D 8 modulo G(D). 

where 

M(D) = m0D*" 7 + mjD^' 2 + .... + mk_2D + m^.j 

is the message polynomial, 

G(D) = D 8 + D 4 ^D 3 ^D 2 + 1 

is the generating polynomial, 

crc(D) =cqD 7 + c}D 6 + + c$ D + cj 

is the check polynomial, and D is the delay operator. That is, CRC is the remainder when Kf(D) D 8 is divided by G(D). The 
CRC check bits are transported in the synchronization bytes (fast and interleaved; 8 bits each) of frame 0 for each data buffer. 
The bits (i.e. message polynomials) covered by the CRC include: 
Fast data buffer 

frame 0: ASx bytes (X = 0, 1, 2, 3), LSx bytes (X= 0, 1, 2), 
followed by any AEX and LEX bytes. 

■ all other frames: fast byte, followed by ASx bytes (X- 0, 1,2, 3), 
LSx bytes (X = 0, 1, 2\ and any AEX and LEX bytes. 

Interleaved data buffer: 

• frame 0: ASx bytes (X= 0, 1, 2, 3), LSx bytes (X = 0, 1, 2), 
followed by any AEX and LEX bytes. 

■ all other frames: sync byte, followed by ASx bytes (X=0, 1 , 2, 3), 
LSx bytes (X = 0, 1, 2), and any AEX and LEX bytes. 

Each byte shall be clocked into the CRC least significant bit first. 

The number of bits over which the CRC is computed varies with the allocation of bytes to the fast and interleaved 
data buffers (the numbers of bytes in ASx and LSx vary according to the [Bp.Bj] pairs; AEX is present in a given buffer only if 
at least one ASx is allocated to that buffer, LEX is present in a given buffer only if at least one ASx or one LSx is allocated to 
that buffer). 

Because of the flexibility in assignment of bearer channels to the fast and interleaved data buffers, CRC field lengths 
over an ADSL superframe will vary from approximately 67 bytes to approximately 14,875 bytes. 
3.4.4.2 Synchronization 

If the bit timing base of the input user data streams is not synchronous with the ADSL modem timing base, the input 
data streams shall be synchronized to the ADSL timing base using the synchronization control mechanism (consisting of 
synchronization control byte and the AEX and LEX bytes). Forward-error-correction coding shall always be applied to the 
synchronization control byte(s). 

If the bit timing base of the input user data streams is synchronous with the ADSL modem timing base, then the 
synchronization control mechanism is not needed, and the synchronization control byte shall always indicate "no 
synchronization action" (see Table 10 and Table 1 1 ). 
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3.4.4.2 1 Svnchmniy^ tion for the fast data buffer. 

Synchronization control for the fast data buffer may occur in frames 2 through 33, and 36 through 67 of an ADSL 
superframe, where the fast byte may be used as the synchronization control byte. No synchronization action shall be taken for 
those frames for which the fast byte is used for CRC, fixed indicator bits, or EOC. 

The format of the fast byte when used as synchronization control for the fast data buffer shall be as given in Table 10. 

Table 1 0- Fast bvte format for synchronization 



Bits 


Designation 


Codes | 


sc7, sc6 


ASx bearer channel designator 


•W : AS0 
"Oh" : AS1 
•W : AS2 

ft 1 t H A O ^ 

lh : AS3 


sc5, sc4 


Synchronization control for the 
designated ASx bearer channel 
(see note 3) 


W 002 H : no synchronization action 

"01 ?" ' add AEX bvte tn rip^ionnt^H A^v Kparor r>Ko««Ai 

"1 1 2" : add AEX and LEX bytes to ASx bearer channel 
" 1 0 2 " : delete last byte from designated ASx bearer channel 


sc3, sc2 


LSx bearer channel designator 
(see note 3) 


•W : LS0 
"Oh" : LSI 
"102- : LS2 

" 1 1 2" : no synchronization action 


scl 


Synchronization control for the 
designated LSx bearer channel 


n 1 2" : add LEX byte to designated LSx bearer channel 
"0 2 " : delete last byte from designated LSx bearer channel 


scO 


Synchronization/EOC designator 


"Oj" : perform synchronization control as indicated in sc7-scl 
"I2" : this byte is part of an EOC frame 



10 



15 



20 



ADSL deployments may need to inter-work with DS1 (1.544 Mbit/s) or DS1C (3.152 Mbit/s) rates. The 
synchronization control option that allows adding up to two bytes to an ASx bearer channel provides sufficient overhead 
capacity to transport combinations of DS1 or DS1C channels transparently (without interpreting or stripping and regenerating 
the framing embedded within the DS1 or DS1C). The synchronization control algorithm shall, however, guarantee that the fast 
byte in some nunimum number of frames is available to carry EOC frames, so that a minimum EOC rate (4 kbit/s) may be 
maintained. 

When the data rate of the C channel is 16 kbit/s, the LS0 bearer channel is transported in the LEX byte, using the 
"add LEX byte to designated LSx channel", with LS0 as the designated channel, every other frame on average. 

If the bit timing base of the input bearer channels (ASx. LSx) is synchronous with the ADSL modem timing base, 
then ADSL systems need not perform synchronization control, (by adding or deleting AEX or LEX bytes to/from the designated 
ASx and LSx channels). In this case, the synchronization control byte shall indicate "no synchronization action" (i.e., sc7-0 
coded "XX001 1X0 2 '\ with X discretionary). 
3.4.4.2.2. Synchronization for the interleaved data buffer 

Synchronization control for the interleaved data buffer can occur in frames 1 through 67 of an ADSL superframe, 
where the sync byte may be used as the synchronization control byte. No synchronization action shall be taken during frame 0, 
where the sync byte is used for CRC during frames when the LEX byte carries the AOC. 



54 



WO 00/07323 



PCT/US99/17369 



The format of the sync byte when used as synchronization control for the interleaved data buffer shall be as given in 
Table 11. In the case where no signals are allocated to the interleaved data buffer, the sync byte shall cany the AOC data 
directly, as shown in Figure 63. 

Table 1 1 - Svnc bvte format for synchronization 



Bits 


Designation 


Codes 


sc7, sc6 


ASx bearer channel designator 


"OO*" : ASO 
"01 2 " : ASI 
"IO2" : AS2 
"lh" : AS3 


sc5, sc4 


Synchronization control for the 
designated ASx bearer channel 
(see note 3) 


"OO2" : no synchronization action 
"Oh" : add AEX byte to designated ASx bearer channel 
" 1 1 2" : add AEX and LEX bytes to ASx bearer channel 
"102" : delete last byte from designated ASx bearer channel 


sc3, sc2 


LSx bearer channel designator 


"002" : LS0 

"fll ~ m * T 
CM 2 . IsO 1 

"10 2 " : LS2 

"1 12* : no synchronization action 


scl 


Synchronization control for the 
designated LSx bearer channel 


"h" : add LEX byte to designated LSx bearer channel 
H 02 w : delete last byte from designated LSx bearer channel 


scO 


Synchronization/AOC designator 


"O2" : perform synchronization control as indicated in sc7-scl 
" 1 2" : LEX byte carries ADSL overhead control channel data; 

synchronization control is allowed for "add AEX" or "delete" as 

indicated in sc7-scl 



ADSL deployments may need to inter-work with DS1 (1.544 Mbit/s) or DS1C (3.152 Mbit/s) rates. The 
synchronization control option that allows adding up to two bytes to an ASx bearer channel provides sufficient overhead 
capacity to transport combinations of DS1 or DS1C channels transparently (without interpreting or stripping and regenerating 
the framing embedded within the DS1 or DS1C). 

When the data rate of the C channel is 16 kbit/s, the LSO bearer channel is transported in the LEX byte, using the 
"add LEX byte to designated LSx channel", with LSO as the designated channel, every other frame on average. 

If the bit timing base of the input bearer channels (ASx, LSx) is synchronous with the ADSL modem timing base then 
ADSL systems need not perform synchronization control by adding or deleting AEX or LEX bytes to/from the designated ASx 
and LSx channels. In this case, the synchronization control byte shall indicate "no synchronization action". In this case, when 
framing mode 1 is used, the sc7-0 shall always be coded "XX001 1XX 2 \ with X discretionary. When scO is set to 1, the LEX 
byte shall carry AOC. When scO is set to 0, the LEX byte shall be coded 00, 6 . The scO may be set to 0 only in between 
transmissions of 5 concatenated and identical AOC messages. 
3.4.4.3 Reduced overhead framing 

The format described for full overhead framing includes overhead to allow for the synchronization of the seven ASx 
and LSx bearer channels. When the synchronization function is not required, the ADSL equipment may operate in a reduced 
overhead mode. This mode retains all the full overhead mode functions except synchronization control. 
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10 



15 



20 



25 



3.4.4.3. 1 Reduced overhead framing with separate fast and svnc bvtes 

The AEX and LEX bytes shall be eliminated from the ADSL frame format, and both the fast and sync bytes gh*li 
carry overhead information. The fast byte carries the fast buffer CRC, indicator bits, and EOC messages, and the sync byte 
carries the interleaved buffer CRC and AOC message. The assignment of overhead functions to fast and sync bytes when "<^"g 
the full overhead framing and when using the reduced overhead framing with separate fast and sync bytes shall be as shown in 
Table 12. 

In the reduced overhead framing with separate fast and sync bytes, the structure of the fast data buffer shall be as 
shown in Figure 64 with Ap and Lp set to 0. The structure of the interleaved data buffer shall be as shown in Figure 65 with Aj 
and Lj set to 0. 

Table 12 - Overhead functions for framing modes 





Full Over! 


lead Mode 


Reduced Overhead Mode 


Frame Number 


Fast Sync 


Interleave Sync 


Fast Sync 


Interleave Sync 


0 


fast CRC 


Interleaved CRC 


fast CRC 


interleaved CRC 


1 


IBO-7 


sync or AOC 


IBO-7 


AOC 


34 


EB8-15 


sync or AOC 


IB8-15 


AOC 


35 


IB16-23 


sync or AOC 


IB16-23 


AOC 


all other frames 


sync or EOC 


sync or AOC 


sync or EOC 
(see NOTE) 


AOC 



NOTE - In the reduced overhead mode only "no synchronization action" code shall be used. 
3.4.4.3.2 Reduced overhead framing with merged fast and svnc bvtes 

In the single latency mode, data is assigned to only one data buffer (fast or interleaved). If data is assigned to only the 
fast buffer, then only the fast byte shall be used to carry overhead information. If data is assigned only to the interleaved 
buffer, then only the sync byte shall be used to carry overhead information. Reduced overhead framing with merged fast and 
sync bytes shall not be used when operating in dual latency mode. 

For ADSL systems transporting data using a single data buffer (fast or interleaved), the CRC, indicator, EOC and 
AOC function shall be carried in a single overhead byte assigned to separate data frames within the superframe structure. The 
CRC remains in frame 0 and the indicator bits in frames 1, 34, and 35. The AOC and EOC bytes are assigned to alternate 
pairs of frames. For ADSL equipment operating in single latency mode using the reduced overhead framing with merged fast 
and sync bytes, the assignment of overhead functions shall be as shown in Table 13. 

In the single latency mode using the reduced overhead framing with merged fast and sync bytes, only one data buffer 
shall be used. If the fast data buffer is used, the structure of the fast data buffer shall be as shown in Figure 64 (with Ap and Lp 
set to 0) and the interleaved data buffer shall be empty (no sync byte and Kj = 0). If the interleaved data buffer is used, the 
structure of the interleaved data buffer shall be as shown in Figure 65 (with Aj and Lj set to 0) and the fast data buffer shall be 
empty (no fast byte and Kp = 0). 
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Table 1 3- Overhead functions for reduced overhead mode with merged fast and svnc bvtes 



Frame Number 


(Fast Buffer Only) 
Fast Byte format 


(Interleaved Buffer Only) 
Sync Byte format 


0 


Fast CRC 


Interleaved CRC 




UJV" / 


ttSU-7 


34 


IB8-15 


IB8-15 


35 


IB 16-23 


IB16-23 


4n+2, 4n+3 
withn = 0...16, n*8 


EOC or sync (see NOTE) 


EOC or sync (see NOTE) 


4n, 4n+l 
withn = 0...16, n*0 


AOC 


AOC 


NOTE - In the reduced overhead mode only the *'no synchronization action" code shall be used. 



3.4.5 Scramblers 

The binary data streams output (LSB of each byte first) from the fast and interleaved data buffers shall be scrambled 
5 separately using the following algorithm for both: 

where d n is the n-th output from the fast or interleaved buffer (i.e., input to the scrambler), and d n * is the #i-th output from the 
corresponding scrambler. This is illustrated in Figure 66. 

These scramblers are applied to the serial data streams without reference to any framing or symbol synchronization. 
1 0 Descrambling in receivers can likewise be performed independent of symbol synchronization. 

3.4.6 Forward error correction 

The ATU-C shall support downstream transmission with at least any combination of the FEC coding capabilities 
shown in Table 14. 



Table 14 - Minimum FEC coding capabilities for ATU-C 



Parameter 


Fast buffer 


Interleaved buffer 


Parity bytes per R-S codeword 


R F = 0,2,4,6,8,10,12,14,16 
(see NOTE 2) 


Ri = 0,2,4,6,8,10,12,14,16 
(see NOTE 1 and NOTE 2) 


DMT symbols per R-S codeword 


S = I 


S = 1,2,4, 8, 16 


Interleave depth 


not applicable 


D= 1,2,4, 8, 16, 32,64 


NOTE 1 - Rf can be > 0 only if K F > 0, and Ri can be > 0 only if Ki > 0 
NOTE 2 - Ri shall be an integer multiple of S. 



The ATU-C shall also support upstream transmission with at least any combination of the FEC coding capabilities 
shown in Table 23. 
3.4.6.1 Reed-Solomon coding 

R (i.e., Rp or /?/) redundant check bytes cq. cj c%_ 2 . C R-] shall be appended to K (i.e., K / or SxA' ( ) message 

20 bytes ntQ, mj m K-2- m K~l to ^ orm a Reed-Solomon code word of size N = K + R bytes. The check bytes are computed 

from the message byte using the equation: 
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C(D) = K4(D) modulo G(D) 

where 

M(D) = ntQD^' 1 + mjD^' 2 + ... + m^ 2 D + m K~l 

is the message polynomial, 
5 C(D) = cqD^' 1 + cj D^' 2 + ... + c R _ 2 D + c R _j 

is the check polynomial, and 

G(D) =P(D + a*) 

is the generator polynomial of the Reed-Solomon code, where the index of the product runs from i = 0 to R-\ . That is, C(D) is 
the remainder obtained from dividing M(D) ifi by G(D). The arithmetic is performed in the Galois Field GF(256), where a is 
10 a primitive element that satisfies the primitive binary polynomial jfl + x^ + x^ + x^+l. A data byte (d j, d $ ... , dj.d q) 

is identified with the Galois Field element dya 7 + d#i 6 ... +dja + dg The number of check bytes is R 9 and the codeword 
size N vary. 

3.4.6.2 Reed-Solomon Forward Error Correction Superfrarne Ry nphmfiiyfltinTi 

When entering the SHOWTIME state after completion of Initialization and Fast Retrain, the ATU shall align the first 
1 5 byte of the first Reed Solomon code-word with the first data byte of DF 0. 

3.4.6.3 Interleaving 

The Reed-Solomon codewords in the interleaved buffer shall be convolutionally interleaved. The interleaving depth 
varies, but shall always be a power of 2. Convolutional interleaving is defined by the rule:" Each of the N bytes Bq, , B v . 
j in a Reed-Solomon codeword is delayed by an amount that varies linearly with the byte index. More precisely, byte B f (with 
20 index i) is delayed by (D-l ) x i bytes, where D is the interleave depth". 

An example for N = 5, D = 2 is shown in Table 1 5, where B?) denotes the i-th byte of the y-th codeword. 



Table 1 5 - Convolutional interleaving example for N = 5. D = 2 



Inter- 
leaver 
input 


B>0 




B>2 


Bi 3 


Bi 4 


BJ +1 o 


B> +1 ! 


Bl +1 2 


Bi +1 3 


B> + * 4 


Inter- 
leaver 
output 


B>0 


B)- l 3 


Bfj 




Bi 2 


BJ + ' 0 


Bi 3 


Bf +l j 


B> 4 


B> +J 2 



With the above-defined rule, and the chosen interleaving depths (powers of 2), the output bytes from the interleaver 
25 always occupy distinct time slots when N is odd. When N is even, a dummy byte shall be added at the beginning of the code- 
word at the input to the interleaver. The resultant odd-length code-word is then convolutionally interleaved, and the dummy 
byte shall then removed from the output of the interleaver. 
3.4.6.4 Support of higher downstream bit rates with S=l/2 

With a rate of 4000 data frames per second and a maximum of 255 bytes (maximum R-S code-word size) per data 
30 frame, the ADSL downstream line rate is limited to approximately 8 Mbit/s per latency path. The line rate limit can be 
increased to about 16 Mbit/s for the interleaved path by mapping two RS code-words into one FEC data frame (i.e., by using 
5=1/2 in the interleaved path). S-\/2 shall be used in the downstream direction only over bearer channel AS0. 
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When the Ki data bytes per interleaved mux data frame cannot be packed into one RS code-word, i.e., Ki is such that Ki + R > 
255, the Ki data bytes shall be split into two consecutive RS code-words. When Ki is even, the first and second code-word 
have the same length Nil = Ni2 = (Kj/2 + Rj), otherwise the first code-word is one byte longer than the second, i.e. first code- 
word has Ni 1 » (Ki + 1 )V2 + Ri bytes, the second code-word hasN f 2 = (K,-iy2 + R, bytes. For the FEC output data frame, Ni 
5 = Nil + N|2, with Nr< 5 1 1 bytes. 

The convolution^ interleaver requires all code-words to have the same odd length. To achieve the odd code-word 
length, insertion of a dummy (not transmitted) byte may be required. For S=l/2, the dummy byte addition to the first and/or 
second code-word at the input of the interleaver shall be as in Table 16. 



Table 16 - Dummy byte insertion at interleaver input for 5 = 1/2 



Njdl 


N,d2 


Dummy Byte Insertion Action 


odd 


odd 


no action 


even 


even 


Add one dummy byte at beginning of both code- words 


odd 


even 


Add one dummy byte at the beginning of the second code- word 


Even 


odd 


Add one dummy byte at the beginning of the first code-word and two dummy bytes at the 
beginning of the second code-word (the de-interleaver shall insert one dummy byte into the de- 
interleaver matrix on the first byte and the (D + 1 )th byte of the corresponding code-word to 
make the addressing work properly. ) 



3.4.7 Tone ordering 

A DMT time-domain signal has a high peak-to-average ratio (PAR) (its amplitude distribution is almost Gaussian), 
and large values may be clipped by the digital-to-analog converter. The error signal caused by clipping can be considered as an 
additive negative impulse for the time sample that was clipped The clipping error power is almost equally distributed across 
all tones in the symbol in which clipping occurs. Clipping is therefore most likely to cause errors on those tones that, in 
anticipation of a higher received SNR, have been assigned the largest number of bits (and therefore have the densest 
constellations). These occasional errors can be reliably corrected by the FEC coding if the tones with the largest number of bits 
have been assigned to the interleave buffer. 

The numbers of bits and the relative gains to be used for every tone shall be calculated in the ATU-R receiver, and 
sent back to the ATU-C according to a defined protocol. The pairs of numbers are stored, in ascending order of frequency (or 
tone number i), in a bit and gain table. 

The -tone-ordered" encoding shall first assign the 8*A/p bits from the fast data buffer to the tones with the smallest 
number of bits assigned to them, and then the fL*N/ bits from the interleave data buffer to the remaining tones. 

All tones shall be encoded with the number of bits assigned to them; one tone may therefore have a mixture of bits 
from the fast and interleaved buffers. 

The ordered bit table b) shall be based on the original bit table bj as follows: 
For k= 0 to 15 

{ 

From the bit table, find the set of all / with the number of bits per tone b i = A- 
Assign bj to the ordered bit allocation table in ascending order of/ 

} 



10 



15 



20 



25 



30 
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A complementary de-ordering procedure should be performed in the ATU-R receiver. It is not necessary, however, to 
send the results of the ordering process to the receiver because the bit table was originally generated in the ATU-R, and 
therefore that table has all the information necessary to perform the de-ordering. 

Figure 67 and Figure 68 show an example of tone ordering and bit extraction (without and with trellis coding 
respectively) for a 6-tone DMT case, with Np=l and Nj=l for simplicity. 
3.4.8 Constellation encoder (Trellis code version 1 ) 

Block processing of Wei's 16-state 4 -dimensional trellis code is optional in the ITU-T recommendation G.992.1 to 
improve system performance. An algorithmic constellation encoder shall be used to construct constellations with a maximum 
number of bits equal to A/downmax» where 8£ Ndrnmux £ 1 5). 
3.4.8.1 Bit extraction 

Data bytes from the data frame buffer shall be extracted according to a re-ordered bit allocation table 6' ;> least 
significant bit first. Because of the 4-dimensional nature of the code, the extraction is based on pairs of consecutive b rather 
than on individual ones, as in the non-trellis-coded case. Furthermore, due to the constellation expansion associated with 
coding, the bit allocation table, b' h specifies the number of coded bits per tone, which can be any integer from 2 to 15. Given 
a pair (x,y) of consecutive b' i$ x+y-7 bits (reflecting a constellation expansion of 1 bit per 4 dimensions, or one half bit per 

tone) are extracted from the data frame buffer. These z = x+y-1 bits {t z . t\ ) are used to form the binary word u as 

shown in Table 17. The tone ordering procedure ensures x s y. Single-bit constellations are not allowed because they can be 
replaced by 2-bit constellations with the same average energy. Refer to 0 for the reason behind the special form of the word u 
for the case x = 0 , y > 1 . 



Table 1 7 - Forming the binary word u 



Condition 


Binary word / comment 


x> 1 t y> 1 


w = < Wz-1* • • '1 ) 


x=\ 9 y*l 


Condition not allowed 


x = 0,jy> 1 


w = (/ r ,r z . 1 , ...,/ 2 .0 1 / lt 0 ) 


x = 0,y=0 


Bit extraction not necessary, no 
message bits being sent 


x = 0, y = 1 


Condition not allowed 


NOTE - ti is the first bit extracted from the data frame buffer 



The last two 4-dimensional symbols in the DMT symbol shall be chosen to force the convolutional encoder state to 
the zero state. For each of these symbols, the 2 LSBs of u are pre-determined, and only (x+ y -3) bits shall be extracted from 
the data frame buffer and shall be allocated to t^U ... r,. 
3 .4 . 8 .2 Bit conversion 

The binary word u=(u z *,u z i_ $ uj) determines two binary words v=^ z .. v ....v^ and >*<=<My j,...,^), which are 

used to look up two constellation points in the encoder constellation table. For the usual case of x >1 and v >1, z* = z = x-s-v-1, 
and v and w contain x and v bits respectively. For the special case of x = 0 and v > 1, z" - z+2 =>h-1, v = (vj,vq) = 0 and m=(u^ 
j,...,w 0 ). The bits (m3,M2,«j) determine (vj,vq) and (w^hq) according to Figure 69. 

The convolutional encoder shown in Figure 69 is a systematic encoder (i.e. iq and m 2 are passed through unchanged) 
as shown in Figure 70. The convolutional encoder state (S 3 , S 2 . Sj. Sq) are used to label the states of the trellis shown in 
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Figure 72. At the beginning of a DMT symbol period the convolutional encoder state is initialized to (0, 0, 0, 0). The remaining 
bits of v and w are obtained from the less significant and more significant parts of {u^, , ,1*4), respectively. When x >\ 
and v > 1, v = {u z *_y+ 2 , «z*-y+l> «4» v l» v 0> 0x16 w = u sf-h V->+3. w h w 0^ W* 101 ' x = 0, the bit extraction and 
conversion algorithms have been judiciously designed so that vj = v Q = 0. The binary word v is input first to the constellation 
encoder, and then the binary word w. 

In order to force the final state to the zero state (0,0,0,0), the 2 LSBs wj and u 2 of the final two 4-dimensional 
symbols in the DMT symbol are constrained to u j = 5j & 53, and u 2 = S 2 . 
3.4.8.3 Coset partition and trellis diagram 

In a trellis code modulation system, the expanded constellation is labeled and partitioned into subsets ("cosets") using 
a technique called mapping by set-partitioning. The four-dimensional cosets in Wei's code can each be written as the union of 
two Cartesian products of two 2-dimensional cosets. For example, C 4 ° = (C 2 ° - C 2 1 ) x (C 2 2 < C 2 3 ). The four constituent 2- 
dimensional cosets, denoted by C 2 ® t C 2 * , C2 2 , C 2 *, are shown in Figure 71 . 

The encoding algorithm ensures that the 2 least significant bits of a constellation point comprise the index 1 of the 2- 
dimensional coset C 2 * in which the constellation point lies. The bits (vj, vq) and (wj t wq) are in fact the binary representations 
of this index. 

The three bits (u^uj.uq) are used to select one of the 8 possible four-dimensional cosets. The 8 cosets are labeled 
C 4 ' where / is the integer with binary representation (u^u j.uq). The additional bit « 3 (see Figure 69) determines which one of 
the two Cartesian products of 2-dimensional cosets in the 4-dimensional coset is chosen. The relationship is shown in Table 
18. The bits (v|,vq) and (w^wq) are computed from (M3»W2» M l» w o) using the linear equations given in Figure 69. 
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Table 18 - Relation between 4-dimensional and 2-dimensional cosets 



4-D Coset 


"3 w 2 M l M 0 


v l v 0 


w \ w 0 


2-D Cosets 




0 0 0 0 

1 n n n 
I U \J U 


0 0 

1 1 
1 1 


0 0 

1 1 

1 1 


C 2 ° , c 2 ° 
C 2 3 « C 2 3 


C4 4 


0 10 0 

1 1 u u 


0 0 

1 1 
I I 


1 1 

U U 


C 2 0 . C 2 3 
C 2 3 . C 2 « 


C4 2 


0 0 10 

1 0 1 0 


1 0 
n 1 


1 0 

n t 
u 1 


C 2 2 „ C 2 2 

c 2 i . c 2 i 




0 110 

1 1 1 n 


1 0 
n 1 


0 1 

1 n 


C 2 2 - C 2 1 
C 2 > . C 2 2 


Q» 


0 0 0 1 

1 n n 1 


0 0 

1 1 
1 I 


1 0 

n 1 
u 1 


C 2 0 . C 2 2 
C 2 3 . C 2 1 




0 10 1 
110 1 


0 0 

1 1 


0 1 

1 0 


c 2 o.c 2 i 

C 2 3 . C 2 2 




0 0 11 
10 11 


1 0 
0 1 


0 0 

1 1 


C 2 2 . C 2 0 
C 2 1 x C 2 3 


c 4 7 


0 111 

1111 


1 0 
0 1 


1 1 
0 0 


C 2 2 » C 2 3 

c 2 i . c 2 « 



Figure 72 shows the trellis diagram based on the finite state machine in Figure 70, and the one-to-one correspondence 
5 between (« 2 , *q» "o> and ^ 4 -dimensional cosets. In the figures, S^fS^Sj^S^SQ) represents the current state, while T = 

7*2, Tj, Tn) represents the next state in the finite state machine. S is connected to T in the constellation diagram by a branch 
determined by the values of u 2 and i/j. The branch is labeled with the 4 -dimensional coset specified by the values of u 2 , "1 
(and uq = Sq , see Figure 71 ). To make the constellation diagram more readable, the indices of the 4-dimensional coset labels 
are listed next to the starting and end points of the branches, rather than on the branches themselves. The leftmost label 
10 corresponds to the uppermost branch for each state. The constellation diagram is used when decoding the trellis code by the 
Viterbi algorithm. 
3.4.8.4 Constellation encoder 

For a given sub-carrier, the encoder shall select an odd-integer point (A'. )*) from the square-grid constellation based 
on the b bits of either {v^.j.v^, -,V|,vn} or {^tA^b^ -.W],wq}. For convenience of description, these b bits are 
15 identified with an integer label whose binary representation is (v^_i,i^_2» - ^'j,v 0 ), but the same encoding rules apply also to 
the w vector. For example, for 6=2, the four constellation points are labeled 0,1,2,3 corresponding to (vj.vq) = (0,0), (0,1), 
( 1 ,0), (1,1), respectively (v 0 is the first bit extracted from the buffer). 
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3.4.8.4. 1 Even values of b 

For even values of b, the integer values X and Y of the constellation point (X. Y) shall be determined from the b bits 
t v M» v b-2> v h v 0) 83 follows* A' and y are the odd integers with twos-complement binary representations (v^j, v^.3,..., 
v\ t 1) and vft~4,...,vo, 1), respectively. The most significant bits (MSBs), v bA and v^_ 2 , are the sign bits for X and Y, 
5 respectively. 

Figure 74 shows example constellations for b = 2 and 6= 4. (The values of X and Y shown represent the output of 
the constellation encoder. These values require appropriate scaling such that 1 ) all constellations regardless of size represent 
the same RMS energy and 2) by the fine gain scaling before modulation by the IDFT ) 

The 4-bit constellation can be obtained from the 2-bit constellation by replacing each label n by a 2 x 2 block of labels 
10 as shown in Figure 74. The same procedure can be used to construct the larger even-bit constellations recursively. 

The constellations obtained for even values of b are square in shape. The least significant bits { vj , v 0 ) represent the 
coset labeling of the constituent 2 -dimensional cosets used in the 4-dimensional Wei trellis code. 

3.4.8.4.2. Odd values of b. b= 3 

Figure 75 shows the constellation for the case b = 3 (the values of X and Y shown represent the output of the 
1 5 constellation encoder. These values require appropriate scaling such that 1 ) all constellations regardless of size represents the 
same RMS energy and 2) by the fine gain scaling before modulation by the IDFT). 

3.4.8.4.3. Odd values of b. h>3 

If b is odd and greater than 3, the 2 MSBs of X and the 2 MSBs of 7 are determined by the 5 MSBs of the b bits. Let 
c = (£+l)/2, then X and Y have the twos-complement binary representations (A r ^Y c . 1 ,v^ -4 ,v^,...,v3 > v 1 ,l) and (Y^Y^v^ 
20 5» v fc-7» v £-9' '^O' 1 )* where Jf c and Y c are the sign bits of X and Y respectively. The relationship between X a X c ^ t Y^ Y c ^ 
and V£_j, v £.2» —» v b~$ * s shown in the Table 19. 
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Table 19. Determining the top 2 bits ofX and Y 



D-I * D-2 » * t>0 


» ^c- 1 


Y Y « - 
*c • x c-l 


/~v rt a\ /A r\ 

0 0 0 0 0 


0 0 


00 


0 0 0 0 1 


0 0 


00 


0 0 0 10 


00 


00 


AAA] I 

UUO 1 1 


0 0 


00 


a a i n ft 

UO I 01; 


0 0 


1 1 


A. ft 1 A 1 
OU 1 U 1 


0 0 


1 1 


ft ft 1 1 ft 
UU 1 1 u 


A A 

U u 


1 1 


ft ft 1 1 1 
UU 1 1 1 


0 0 


1 1 


ft 1 ft ft ft 


1 1 


0 0 


ft 1 ft ft 1 
U 1 UU 1 


1 1 


00 


ft 1 ft 1 ft 
U 1 U 1 u 


1 1 


0 0 


ft 1 ft 1 1 
U 1 U 1 I 


1 1 


0 0 


ft 1 1 ft A 

U 1 1 u u 


1 1 


1 1 


A 1 1 A 1 

U 1 1 U 1 


1 1 


1 1 


A 1 1 1 A 

U 1 1 1 U 


1 1 


1 1 


A 1 1 1 1 

U 1 1 I 1 


1 1 


1 1 


1 ft ft ft ft 

1 u u u u 


A 1 

0 1 


00 


1 ft ft ft 1 

1 UUU 1 


A 1 

U 1 


0 0 


1 ft ft 1 ft 


1 A 

1 0 


0 0 


1 ft ft 1 1 
1 UU 1 1 


1 0 


00 


1 ft 1 ft A 

1 U I UU 


0 0 


0 1 


1 ft 1 ft 1 
I U 1 U 1 


0 0 


1 0 


1 A 1 1 f\ 

I U 1 1 u 


0 0 


0 1 




0 0 


1 0 


110 0 0 


1 ] 


0 1 


110 0 1 

1 1 V V I 


1 1 
1 1 


t ft 

I u 


I 1 0 1 0 


1 1 


0 1 


110 11 


1 1 


1 0 


11100 


0 1 


1 1 


1110 1 


0 1 


1 1 


11110 


1 0 


1 1 


11111 


1 0 


1 1 



Figure 76 shows the constellation for the case b = 5 (the X and Y values are on a ±1, ±3, ... grid. The values of X 
and Y shown represent the output of the constellation encoder. These values require appropriate scaling such that: 

1 ) all constellations regardless of size represents the same RMS energy and 

2) by the fine gain scaling before modulation by the IDFT. 
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The 7-bit constellation shall be obtained from the 5-bit constellation by replacing each label n by the 2x2 block of 
labels as shown in Figure 74. 

Again, the same procedure shall be used to construct the larger odd-bit constellations recursively. Note also that the 
least significant bits {vj„ vq} represent the coset labeling of the constituent 2 -dimensional cosets used in the 4-dimensional 
5 Wei trellis code. 

3-4.9 Constellation encoder (No Trellis coding^ 

An algorithmic constellation encoder shall be used to construct constellations with a maximum number of bits equal 
to A^downmax » where 8 £ Ndewnmax £ 15. The constellation encoder shall not use trellis coding with this option. 
3.4.9.1 Bit extraction 

10 Data bits from the frame data buffer shall be extracted according to a re-ordered bit allocation table 6',*, least 

significant bit first. The number of bits per tone, can take any non-negative integer values not exceeding Afaownmax* and 
greater than 1. For a given tone b = b'j bits are extracted from the data frame buffer, and these bits form a binary word {v^_ 
1 » v 6-2» ** v l » v oi • ^ ne ^ u * st extracted shall be vo , the LSB. 

3.4.10 Gain scaling 

15 For the transmission of data symbols gain scaling, g/ 1 shall be applied as requested by the ATU-R and possibly 

updated during Showtime via a bit swap procedure. Only values of gj equal to zero or within a range of approximately 0. 1 9 to 
1 .33 (i.e., -14.5 dB to +2.5 dB) may be used. For the transmission of synchronization symbols, no gain scaling shall be applied 
to any sub-carrier. 

Each constellation point, CY,,!',*), i.e. complex number X / + output from the encoder is multiplied by g/ : 
20 Zi-giffi+JYO 

3.4.11 Modulation 
3.4.11.1 Sub-carriers 

The frequency spacing, Af, between sub-carriers is 4.3125 kHz, with a tolerance of +/- 50 ppm. 
3.4.11.1.1 Data sub-carriers 

25 The channel analysis signal allows for a maximum of 255 carriers (at frequencies nAf , n - 1 to 255) to be used. The 

lower limit of n depends on both the duplexing and service options selected. For example, for ADSL above POTS service 
option, if overlapped spectrum is used to separate downstream and upstream signals, then the lower limit on n is determined by 
the POTS splitting filters; if frequency division multiplexing (FDM) is used, the lower limit is set by the downstream-upstream 
separation filters. 

30 3 A 11.1.2 Pilot 

Carrier #//pik>t (/plot = 4.3125 x N^* kHz) shall be reserved for a pilot; that is b(NpZot) = 0 and g(jVp2ot) = 1. 

The data modulated onto the pilot sub-carrier shall be a constant {0,0} . Use of this pilot allows resolution of sample 
timing in a receiver modulo-8 samples. Therefore a gross timing error that is an integer multiple of 8 samples could still persist 
after a micro-interruption (e.g., a temporary short- circuit, open circuit or severe line hit); correction of such timing errors is 
35 made possible by the use of the synchronization symbol. 

3.4.11.1.3 Nvquist frequency 

The carrier at the Nvquist frequency (#256) shall not be used for user data and shall be real valued. 

3.4.11.1.4 DC 

The carrier at DC (#0) shall not be used, and shall contain no energy. 
40 3.4. 1 1 .2 Modulation bv the inverse discrete Fourier transform (IDFn 

The modulating transform defines the relationship between the 512 real values x n and the Z/ . 
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/=0 

The constellation encoder and gain scaling generate only 255 complex values of Z,\ In order to generate real values of x n the 
input values (255 complex values plus zero at DC and one real value for Nyquist if used) shall be augmented so that the vector 
Z has Hermitian symmetry. That is, 

Z, = conj (Z'572-j ) for i = 257 to 51 1 

3.4.11.3 Synchronization symbol 

The synchronization symbol permits recovery of the frame boundary after micro-interruptions that might otherwise 
force retraining. The data symbol rate,/^, = 4 kHz, the carrier separation, A/= 4.3125 kHz, and the IDFT size, N = 512, are 
such that a cyclic prefix of 40 samples could be used. That is, 

(512 + 40) x 4.0 = 512 x 4.3125 = 2208 

The cyclic prefix shall, however, be shortened to 32 samples, and a synchronization symbol (with a nominal length of 
544 samples) is inserted after every 68 data symbols. That is, 

(512 + 32) x 69 = (512 + 40) x 68 

The data pattern used in the synchronization symbol shall be the pseudo-random sequence PRD, (d n , for n = 1 to 5 12) 
defined by 

d n = 1 f or « = 1 to 9 

d n - d n ^ 0 d n j$ for n =10 to 512 

The first pair of bits (d\ and d^) shall be used for the DC and Nyquist sub-carriers (the power assigned to them is 
zero, so the bits are effectively ignored). The first and second bits of subsequent pairs are then used to define the Xg and Y, for 
i = 1 to 255 as shown in Table 20. 



Table 20. Mapping of two data bits into a 4QAM constellation 



d2i+l,d2i+2 


Decimal label 


X h 7,. 


0 0 


0 


+ + 


0 1 


1 


+ - 


1 0 


2 


- + 


1 1 


3 





The period of the PRD is only 51 1 bits, so d512 shall be equal to dl. The dl - d9 shall be re-initialized for each 
synchronization symbol, so each symbol uses the same data. Bits 129 and 130, which modulate the pilot carrier, shall be 
overwritten by {0,0}: generating the {+,+} constellation. 

The minimum set of sub-carriers to be used is the set used for data transmission (i.e., those for which b t > 0). The 
data modulated onto each sub-carrier shall be as defined above; it shall not depend on which sub-carriers are used. 

3.4.12. Cvclic prefix 

The last 32 samples of the output of the IDFT (x„ for n = 480 to 5 1 1 ) shall be prepended to the block of 512 samples 
and read out to the digital-to-analog converter (DAC) in sequence. That is, the subscripts, /j. of the DAC samples in sequence 
are 480 511,0 511. 

3.4. 1 3. Transmitter dynamic range 

The transmitter includes all analog transmitter functions: the D/A converter, the anti-aliasing filter, the hybrid 
circuitry, and the high-pass part of the POTS or ISDN splitter. 
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3.4. 13.1. Maximum clipping rate 

The maximum output signal of the transmitter shall be such that the signal shall be clipped no more than 0.00001% 
of the time. 

3.4.13.2. Noise/Distortion floor 

5 The signal to noise plus distortion ratio of the transmitted signal in a given sub-carrier is specified as the ratio of the 

rms value of the tone in that sub-carrier to the rms sum of all the non-tone signals in the 4.3125 kHz frequency band centered 
on the sub-carrier frequency. This ratio is measured for each sub-carrier used for transmission using a MultiTone Power Ratio 
(MTPR) test as shown in Figure 77. 

Over the transmission frequency band, the MTPR of the transmitter in any sub-carrier shall be no less than (3Afaowni 
10 + 20)dB, where #downi » s defined as the size of the constellation (in bits) to be used on sub-carrier / . The minimum 
transmitter MTPR shall be at least 38dB (corresponding to an Ndowni of 6) for any sub-carrier. 

Signals transmitted during normal initialization and data transmission cannot be used for this test because the DMT 
symbols have a cyclic prefix appended, and the PSD of a non-repetitive signal does not have nulls at any sub-carrier 
frequencies. A gated FFT-based analyzer could be used, but this would measure both the non-linear distortion and the linear 
1 5 distortion introduced by the transmit Alter. Therefore this test will require that the transmitter be programmed with special 
software probably to be used during development only. 
3.5 ATU-R Functional Characteristics 

An ATU-R may support STM transmission or ATM transmission or both framing modes that shall be supported, depend 
upon the ATU-R being configured for either STM or ATM transport. If framing mode k is supported, then modes k-1, 0 
20 shall also be supported. 

During initialization, the ATU-C and ATU-R shall indicate a framing mode number 0, 1 , 2 or 3 which they intend to use. 
The lowest indicated framing mode shall be used. 

An ATU-R may support reconstruction of a Network Timing Reference (NTR) from the downstream indicator bits. 
3.5.1 STM Transmission Protocol Specific functionalities 
25 3.5.1.1 ATU-R input and output V interfaces for STM transport 

The functional data interfaces at the ATU-R are shown in Figure 78. Output interfaces for the high-speed downstream 
simplex bearer channels are designated AS0 through AS3; input-output interfaces for the duplex bearer channels are 
designated LS0 through LS2. There may also be a functional interface to transport operations, adniinistration and maintenance 
(OAM) indicators from the CI to the ATU-R; this interface may physically be combined with the LS0 interface. 
30 3.5.1.2 Downstream simplex channels - Transceiver bit rates 

The simplex channels are transported in the downstream direction only; therefore their data interfaces at the ATU-R 
operate only as outputs. 

3.5.1.3 Duplex channels - Transceiver bit rates 

The duplex channels are transported in both directions, so the ATU-R shall provide both input and output data 
35 interfaces. 

3.5.1.4 Framing Structure for STM transport 

An ATU-R configured for STM transport shall support the full overhead framing structure 0. The support of full 
overhead framing structure 1 and reduced overhead framing structures 2 and 3 is optional. 

Preservation of T-R interface byte boundaries (if present) at the U-R interface may be supported for anv of the U-R 
40 interface framing structures. 

An ATU-R configured for STM transport may support reconstruction of a Network Timing Reference (NTR). 



67 



WO 00/07323 



PCT/US99/17369 



3.5.2 ATM Transport Protocol Specific functionalities 

3.5.2. 1 ATU-R input and output V interfaces for ATM transport 

The ATU-R input and output T interfaces are identical to the ATU-C input and output interfaces, as shown in Figure 

79. 

3.5.2.2 ATM Cell specific functionalities 

The ATM cell specific functionalities performed at the ATU-R shall be identical to the ATM cell specific 
functionalities performed at the ATU-C. 

3.5.2.3 Framing Structure for ATM transport 

An ATU-R configured for ATM transport shall support the full overhead framing structures 0 and 1 . 

The ATU-R transmitter shall preserve T-R interface byte boundaries (explicitly present or implied by ATM cell 
boundaries) at the U-R interface, independent of the U-R interface framing structure. 

An ATU-R configured for ATM transport may support reconstruction of a Network Timing Reference (NTR). 
To ensure framing structure 0 interoperability between an ATM ATU-R and an ATM cell TC plus an STM ATU-C (i.e., 
ATM over STM), the following shall apply 

• An STM ATU-C transporting ATM cells and not preserving V-C byte boundaries at the U-C interface shall indicate 
during initialization that frame structure 0 is the highest frame structure supported; 

• An STM ATU-C transporting ATM cells and preserving V-C byte boundaries at the U-C interface shall indicate 
during initialization that frame structure 0, 1, 2 or 3 is the highest frame structure supported, as applicable to the 
implementation; 

• An ATM ATU-R receiver operating in framing structure 0 can not assume that the ATU-C transmitter will preserve 
V-C interface byte boundaries at the U-C interface and shall therefore perform the cell delineation bit-by-bit 

3.5.3 Network timing reference 

If the ATU-C has indicated that it will use indicator bits 20 to 23 to transmit the change of phase offset, the ATU-R 
may deliver the 8 kHz signal to the T-R interface 
3.5.4 Framing 

Framing of the upstream signal (ATU-R transmitter) closely follows the downstream framing (ATU-C transmitter), 
but with the following exceptions: 

• There are no ASx channels and no AEX byte; 

• A maximum of three channels exist, so that only three B? t B\ pairs are specified; 

• The minimum RS FEC coding parameters and interleave depth differ (see Table 23); 

• Four bits of the fast and sync bytes are unused (corresponding to the bit positions used by the ATU-C transmitter to 
specify synchronization control for the ASx channels) (see Table 21 and Table 22). 

• The four indicator bits for NTR transport are not used in upstream direction. 

Two types of framing are defined: full overhead and reduced overhead. Furthermore, two versions of full overhead 
and two versions of reduced overhead are defined. The four resulting framing structures are defined as for the ATU-C and are 
referred to as framing structures 0, 1 , 2 and 3. 

Requirements for framing structures to be supported, depend upon the ATU-R being configured for either STM or 
ATM transport. 

Outside the ASx/LSx serial interfaces data bytes are transmitted MSB first in accordance with ITU-T 
Recommendations G.703, G.707, 1.361, and 1.432. All serial processing in the ADSL frame (e.g., CRC, scrambling, etc.) shall, 
however, be performed LSB first, with the outside world MSB considered by the ADSL as LSB. As a result, the first incoming 
bit (outside world MSB) will be the first processed bit inside the ADSL (ADSL LSB) 
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3.5.4. 1 Data symbols 

The ATU-R transmitter is functionally similar to the ATU-C transmitter, except that up to three duplex data channels 
are synchronized to the 4 kHz ADSL DMT symbol rate (instead of up to four simplex and three duplex channels as is the case 
for the ATU-C). The ATU-R transmitter and its associated reference points for data framing are shown in Figure 55 and Figure 
56. 

3.5.4. 1 . 1 Superframe structure 

The superframe structure of the ATU-R transmitter is identical to that of the ATU-C transmitter, shown in Figure 6 1 . 

The ATU-R shall support the indicator bits. The indicator bits, ib20-23, shall not transport NTR in the upstream 
direction and shall be set to 1. 
3.5.4.1.2. Frame structure (with full overhead^ 

Each data frame shall be encoded into a DMT symbol. As specified for the ATU-C shown in Figure 6 1 , each frame is 
composed of a fast data buffer and an interleaved data buffer, and the frame structure has a different appearance at each of the 
reference points (A, B, and C). The bytes of the fast data buffer shall be clocked into the constellation encoder first, followed 
by the bytes of the interleaved data buffer. Bytes are clocked least significant bit first. 

The assignment of bearer channels to the fast and interleaved buffers shall be configured during initialization with 
the exchange of a (Bp^i) pair for each data stream, where By designates the number of bytes of a given data stream to allocate 
to the fast buffer, and Bj designates the number of bytes allocated to the interleaved data buffer. 

The three possible (Bp^l) pairs are #F(LSx), BtfLSx) forX= 0, 1 and 2, for the duplex channels; they are specified 
as for the ATU-C. 
3.5.4.1.2.1 Fast data buffer 

The frame structure of the fast data buffer is the same as that specified for the ATU-C with the following exceptions: 

• ASx bytes do not appear, 

• The AEX byte does not appear, 

The following shall hold for the parameters shown in Figure 80. 
C p (LS0) = 0 if B p (LS0) = 255 (1 1 1 1 1 1 1 1 2 ) 
= B F (LS0) otherwise 

L F =0 if BKLS0) = BKLS1) = BKLS2) = 0 

= 1 otherwise 

K F = 1 + C^LSO) + Bf(LS1 ) + BKLS2) + L F 

N p =K F + R F 

where Rp = number of upstream FEC redundancy bytes in fast path. 

At reference point A (the mux data frame) in Figure 55 and Figure 56 the fast buffer always contains at least the fast 
byte. This is followed by £p(LS0) bytes of channel LS0, then £p(LSl ) bytes of channel LSI, and £p(LS2) bytes of channel 
LS2, and if any Bp(LSx) is non-zero, a LEX byte. 

When 5f(LS0) = 255 ( 1 1 1 1 1 1 1 1 2 ), no separate bytes are included for the LS0 channel. Instead, the 16 kbit/s C 
channel shall be transported in every other LEX byte on average, using the synchronization byte to denote when to add the LEX 
byte to the LS0 bearer channel. 

/?p FEC redundancy bytes shall be added to the mux data frame (reference point A) to produce the FEC output data 
frame (reference point B), where % is given in the C-RATES1 signal options received from the ATU-C during initialization. 
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Because the data from the fast data buffer is not interleaved, the constellation encoder input data frame (reference point C) is 
identical to the FEC output data frame (reference point B). 
3.5 A 1.2.2 Interleaved data buffer 

The frame structure of the interleaved data buffer is shown in Figure 8 1 for the three reference points that are defined 
5 in Figure 55 and Figure 56. This structure is the same as that specified for the ATU-C, with the following exceptions: 

• ASx bytes do not appear, 

• the AEX byte does not appear. 

The following shall hold for the parameters shown in Figure 81 : 
CflJSO) = 0 if B ( (LS0) = 255 (1 1 11 1 1 1 h) 
10 = BjCLSO) otherwise 

Li =0 if Bj(LS0) = BtfLSl) = Bi(LS2) = 0 

- 1 otherwise 

Ki = 1 + CfLSQ) + Bi(LSl ) + Bi(LS2) + Li 

Nj ^(S'Kj + ^yS 

1 5 where Rj = number of upstream FEC redundancy bytes in interleaved path and S = number of mux data frames per FEC 
codeword. 

3.5.4. 1 .3 Cyclic redundancy check ( CRC} 

Two cyclic redundancy checks (CRCs) - one for the fast data buffer and one for the interleaved data buffer - are 
generated for each superframe and transmitted in the first frame of the following superframe. Eight bits per buffer type (fast or 
20 interleaved) per superframe are allocated to the CRC check bits. These bits are computed from the k message bits using the 
equation: 

crc(D) = M(D) D 8 modulo G(D), 

where 

A/(D) = moE^" 1 + m\V^' 2 + .... + m^O + mfc-l 

25 is the message polynomial, 

G(D) = D 8 + D 4 + D 3 + D 2 + 1 

is the generating polynomial, 

crc(D) = roD 7 + ciD 6 + + c$ D + cj 

The CRC bits are transported in the fast byte (8 bits) of frame 0 in the fast data buffer, and the sync byte (8 bits) of 
30 frame 0 in the interleaved data buffer. The bits covered by the CRC include; 

• for the fast data buffer 

■ frame 0: LSx bytes (A' =0,1,2), followed by the LEX byte; 

all other frames: fast byte, followed by LSx bytes (X « 0, 1 , 2), and LEX byte. 

• for the interleaved data buffer 

35 • frame 0: LSx bytes (X = 0, 1 , 2), followed by the LEX byte; 

■ all other frames: sync byte, followed by LSx bytes (X = 0, 1 , 2), and LEX byte. 
Each byte shall be clocked into the CRC least significant bit first. 

The CRC -generating polynomial, and the method of generating the CRC byte are the same as for the downstream 

data. 
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3.5.4.2 Synchronization 

If the bit timing base of the input user data streams is not synchronous with the ADSL modem tuning base the input 
data streams shall be synchronized to the ADSL timing base using the synchronization control mechanism (consisting of 
synchronization control byte and the LEX byte). Fonvard-error-correction coding shall always be applied to the 
5 synchronization control byte(s). 

If the bit timing base of the input user data streams is synchronous with the ADSL modem timing base then the 
synchronization control mechanism is not needed. The synchronization control byte shall always indicate "no synchronization 
action". 

3.5.4.2. 1 . Synchronization for the fast data buffer 
10 Synchronization control for the fast data buffer can occur in frames 2 through 33 and 36 through 67 of an ADSL 

superframe, where the fast byte may be used as the synchronization control byte. No synchronization action is to be taken for 

those frames in which the fast byte is used for CRC, fixed indicator bits, or EOC. The format of the fast byte when used as 

synchronization control for the fast data buffer shall be as given in Table 2 1 . 

In the case where no signals are allocated to the interleaved data buffer, the sync byte carries the AOC data directly 
15 as shown in Figure 63. 



Table 2 1 - Fast bvte format for synchronization 



Bit 


Application 


Specific usage 


sc7-sc4 


not used 


set to M 0 2 M until specified otherwise 


sc3, sc2 


LSx channel designator 


"Q0 2 " : channel LSO 
"01 2" : channel LSI 
"IO2" : channel LS2 
"1 h" : no synchronization action 


scl 


Synchronization control for the 
designated LSx channel 


"h" : add LEX byte to designated LSx channel 
"02" : delete last byte from designated LSx channel 


scO 


Synchronization/EOC designator 


"O2" : perform synchronization control as indicated in sc7-scl 
"1 2 " : this byte is part of an EOC frame 



If the bit timing base of the input bearer channels (LSx) is synchronous with the ADSL modem timing base then 
ADSL systems need not perform synchronization control by adding or deleting LEX bytes to/from the designated LSx channels. 
20 The synchronization control byte shall indicate "no synchronization action" (i.e., sc7-0 coded "00001 IXO2", with X 
discretionary). 

When the data rate of the C channel is 16 kbit/s, the LSO bearer channel shall be transported in the LEX byte, using 
the "add LEX byte to designated LSx channel", with LSO as the designated channel, every other frame on average. 
3 . 5 .4 .2 . 2 . Synchronization for the interleaved data buffer 
25 Synchronization control for the interleaved data buffer can occur in frames 1 through 67 of an ADSL superframe, 

where the sync byte may be used as the synchronization control byte. No synchronization action shall be taken during frame 0, 
where the sync byte is used for CRC, and frames when the LEX byte carries the AOC. 

The format of the sync byte when used as synchronization control for the interleaved data buffer shall be as given in 
Table 22. In the case where no signals are allocated to the interleaved data buffer, the sync byte shall carry the AOC data 
30 directly, as shown in Figure 63. 
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Table 22 - Svnc bvte for mat for synchronization 



Bit 


Application 


Specific usage - 


sc7-sc4 


not used 


Set to "(h n until specified otherwise 


sc3, sc2 


LSx channel designator 


*00 2 " : channel LSO 
"01 2 " : channel LSI 
"IO2" : channel LS2 
"1 12" : no synchronization action 


scl 


Synchronization control for the 
designated LSx channel 


*h" : add LEX byte to designated LSx channel 
"O2" : delete last byte from designated LSx channel 


scO 


Synchronization/AOC designator 


"0? w : perform synchronization control as indicated in sc3-scl 
"h" : LEX byte carries ADSL overhead control channel data; a 

delete synchronization control may be allowed as indicated in 

sc3-scl 



When the data rate of the C channel is 16 kbit/s, the LSO bearer channel shall be transported in the LEX byte, using 
5 the "add LEX byte to designated LSx channel", with LSO as the designated channel, every other frame on average. 

If the bit timing base of the input bearer channels (LSx) is synchronous with the ADSL modem timing base then 
ADSL systems need not perform synchronization control by adding or deleting LEX bytes to/from the designated LSx channels, 
and the synchronization control byte shall indicate "no synchronization action". In this case, and when framing structure 1 is 
used, the sc7-0 shall always be coded "00001 1XX 2 \ with X discretionary. When scO is set to 1, the LEX byte shall carry AOC. 
10 When scO is set to 0, the LEX byte shall be coded 00 1 6 . The scO may be set to 0 only in between transmissions of 5 
concatenated and identical AOC messages. 
3.5.4.3 Reduced overhead framing 

The format described in 2.5.4.1.2 for full overhead framing includes overhead to allow for the synchronization of 
three LSx bearer channels. When the synchronization function described in 2.5.4.2 is not required, the ADSL equipment may 
1 5 operate in a reduced overhead mode. This mode retains all the full overhead mode functions except synchronization control. 
When using the reduced overhead framing, the framing structure shall be as defined in 2.4.4.3. 1 (when using separate fast and 
sync bytes) or2.4.4.3.2 (when using merged fast and sync bytes) 

3.5.5 Scramblers 

The data streams output from the fast and interleaved buffers shall be scrambled separately using the same algorithm 
20 as for the downstream signal. 

3.5.6 Forward error correction 

The upstream data shall be Reed-Solomon coded and interleaved using the same algorithm as for the downstream 

data. 

The ATU-R shall support upstream transmission with at least any combination of the FEC coding capabilities shown 
25 in Table 23. 
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Table 23 ■ Minimum FEC coding capabilities for ATU-R 



Parameter 


Fast buffer 


Interleaved buffer 


Parity bytes per R-S codeword 


Rf^ 0,2,4,6,8,10,12,14,16 
(see NOTE 2) 


Ri = 0,2,4,6,8,10,12,14,16 
(see NOTE 1 and NOTE 2) 


DMT symbols per R-S codeword 


S= 1 


S= 1,2,4, 8, 16 


Interleave depth 


not applicable 


D= 1,2,4,8 


NOrE l -/</rcanbe>OonJyit^>0and/?/canbe>0onlyif/:/>0 
NOTE 2 - Ri shall be an integer multiple of S. 



10 



15 



20 



25 



30 



The ATU-R shall also support upstream transmission with at least any combination of the FEC coding capabilities 
shown in Table 14. 

3.5.7 Tone ordering 

The tone-ordering algorithm shall be the same as for the downstream data. 

3.5.8 Constellation encoder - Trellis version 

Block processing of Wei's 16-state 4-dimensional trellis code to improve system performance is optional. An 
algorithmic constellation encoder shall be used to construct constellations with a maximum number of bits equal to A^upmax. 
where 8 < Af U pmax £ 15. 

The encoding algorithm shall be the same as that used for downstream data (with the substitution of the constellation 
limit of Afupmax for ^downmax)- 

3.5.9 Constellation encoder - Uncoded version 

An algorithmic constellation encoder shall be used to construct constellations with a maximum number of bits equal 
to ^upmax * where 8 < Mipmax ^ 15. The encoding algorithm is the same as that used for downstream data (with the 
substitution of the constellation limit of A^ upmax for Afaownmax) The constellation encoder shall not use trellis coding with 
this option. 

3.5.10 Gain scaling 

For the transmission of data symbols gain scaling, g/ t shall be applied as requested by the ATU-C and possibly 
updated during Showtime via the bit swap procedure. Only values of g/ equal to 0 or within a range of approximately 0.19 to 
1.33 (i.e., -14.5 dB to +2.5 dB) may be used. For the transmission of synchronization symbols, no gain scaling shall be applied 
to any sub-carrier. 

Each constellation point, (A/.17X i.e. complex number, A* / + jYj, output from the encoder is multiplied by g i: 
3.5.11. Modulation 

Frequency spacing, Af, between sub-carriers shall be 4.3125 kHz with a tolerance of +/- 50 ppm. 
3.5.1 1.1. Sub-carriers 
3.5. 11.1.1. Data sub-carriers 

The channel analysis signal allows for a maximum of 31 carriers (at frequencies nAf) to be used. The range of /; 
depends on the service option selected. For example, for ADSL above POTS the lower limit is set by the POTS/ADSL splitting 
filters: the upper limit is set by the transmit and receive band-limiting filters, and shall be no greater than 31. The cut-off 
frequencies of these filters are at the discretion of the manufacturer because the range of usable n is determined during the 
channel estimation. 
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3 . 5. 1 1 . 1 .2 Nvouist frequency 

The sub-carrier at the Nyquist frequency shall not be used for user data and shall be real valued 

3.S T 1M.3 DC 

The sub-carrier at DC (#0) shall not be used, and shall contain no energy. 
5 3.5.1 1.2. S ynchronira tion symbol 

The synchronization symbol permits recovery of the frame boundary after micro-interruptions that might otherwise 
force retraining. 

The data symbol rate, fsymb ~ 4 kHz, the sub-carrier separation, Af = 4.3125 kHz, and the IDFT size, jV = 64, are 
such that a cyclic prefix of 5 samples could be used That is, 
10 (64 + 5) •4.0 = 64 • 43125 = 276 

The cyclic prefix shall, however, be shortened to 4 samples, and a synchronization symbol (with a nominal length of 68 
samples) inserted after every 68 data symbols. That is, 

(64 + 4)*69 = (64 + 5)*68 

The nainimum set of sub-carriers to be used is the set used for data transmission (i.e., those for which 6/ > 0); sub-carriers for 
1 5 which bi ~ 0 may be used at a reduced PSD. The data modulated onto each sub-carrier shall be as defined above; it shall not 
depend on which sub-carriers are used 
3.5.12. Transmitter dynamic range 

The transmitter includes all analog transmitter functions: the D/A converter, the anti-aliasing filter, the hybrid 
circuitry, and the POTS splitter. 
20 3.5.12.1. Maximum clipping rate 

The maximum output signal of the transmitter shall be such that the signal shall be clipped no more than 0.00001% 
of the time. 

3.5.12.2 Noise/Distortion floor 

The signal to noise plus distortion ratio of the transmitted signal in a given sub-carrier ((S/N+D)0 is specified as the 
25 ratio of the rms value of the full-amplitude tone in that sub-carrier to the rms sum of all the non-tone signals in the 4.3125 kHz 

frequency band centered on the sub-carrier frequency. This ratio is measured for each sub-carrier used for transmission using a 

Multi-Tone Power Ratio (MTPR) test as shown in Figure 77. 

Over the transmission frequency band, the MTPR of the transmitter in any sub-carrier shall be no less than 

(3Af U pi + 20) dB, where /V up i is defined as the size of the constellation (in bits) to be used on sub-carrier /. The transmitter 
30 MTPR shall be +38dB (corresponding to an W up i of 6) for any sub-carrier. 

Signals transmitted during normal initialization and data transmission cannot be used for this test because the DMT 

symbols have a cyclic prefix appended, and the PSD of a non-repetitive signal does not have nulls at any sub-carrier 

frequencies. A gated FFT-based analyzer could be used, but this would measure both the non-linear distortion and the linear 

distortion introduced by the transmit filter. Therefore this test will require that the transmitter be programmed with special 
35 software, probably to be used during development only. 

4.- Use of SMCCC and PMCCC for wired communications as xDSL. 

We now describe the use of SMCCC and PMCCC for xDSL systems and in particular, apply it to the case of ADSL 

transceivers. The use for other xDSL systems and other data communications systems is straightforward. It should be noted 

that the appended claims are not intended to be limited to the particular application of ADSL. 
40 An SMCCC is formed by two (or more) constituent systematic encoders joined through an interleaver. The input 

information bits feed the first encoder and after having been scrambled by the interleaver, enter the second encoder. A code 

word of a serial concatenated code comprises of the input bits to the first encoder followed by the parity check bits of both 
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encoders. SMCCC achieves near-Shannon-lunit error correction performance. Here we describe the proposed encoder, the 

decoder and some simulation results. 

4.1- Parallel Multiple Convolutional Concatenated Codes. 

A PMCCC encoder is formed by two (or more) constituent systematic encoders joined through one or more 
interleaves. The input information bits feed the first encoder and, after having been scrambled by the interleaver, enter the 
second encoder. A code word of a parallel concatenated code comprises of the input bits to the first encoder followed by the 
parity check bits of both encoders. Here we present the proposed encoder, the decoder and some simulation results. The 
disadvantage of the PMCCC is that it has a floor-error around 10*. This could be improved with a good interleaver design, but 
using a large number of iterations. 

4.2.1- Par allel Multiple Convolutional Concatenated Codes Encoder. 

A PMCCC encoder comprises of two parallel concatenated recursive systematic convolutional encoders separated by 
an interleaver. The encoders are arranged in a ''parallel concatenation". In a preferred embodiment, the concatenated recursive 
systematic convolutional encoders may be identical. 

Figure 82 represents the proposed encoder. The input is a block of information bits. The two encoders generate 
parity symbols {u 0 and u ' 0 ) from two simple recursive convolutional codes. The key innovation of this technique is an 
interleaver "f\ which permutes the original information bits before input to the second encoder. The permutation performed 
by the interleaver allows those input sequences for which one encoder produces low-weight codewords to usually cause the 
other encoder to produce high-weight codewords. Thus, even though the constituent codes are individually weak, the 
combination is surprisingly powerful. The resulting code has features similar to a "random" block code. 

In this way, we have the information symbols (w/ and u 2 ) and two redundant symbols (u 0 and u ' 0 ). With this 
redundancy it is possible to reach longer loops and to reduce the PAR, at the cost of a slight increase of the constellation 
encoder. 

In the Figure 83 we have presented the conversion that we propose, taking into account the new parity bit 

4.2.2- Parallel Multiple convolutional Concatenated Codes Decoder. 

In Figure 84 we present the decoder, that uses an iterative technique, with two soft-decision input/output trellis 
decoder in each decoding state. The Maximum-a-Posteriori (MAP) Trellis decoder provides the soft output result suitable for 
PMCCC decoding. 

The first decoder should deliver a soft output to the second decoder. The logarithm of the Likelihood Ratio (LLR) of 
a bit decision is the soft decision information output by the MAP decoder. 

Let u k be the binary random variable taking values in {0J} y representing the sequence of information bits u=(u h .„uj. The 
optimum decision algorithm on the Ax/ j bit u k is based on the conditional log-likelihood ratio Z* 

P , u -,\ v) zftw 

where P(uJ are the a priori probabilities. 

Using Bayes* rule and the following approximation: 

P(v\yi)* hTi(u k ) (108) 
*=/ 

The MAP algorithm approximates a nonseparable distribution with a separable one. It is possible to separate P(u\yJ 

e u *L* 

p *(ut) = - t 77 (109) 

/-re-* 
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U = f(y lt L 0 *L 2 .k)+ + L 2 k 010) 

Far binary modulation: 



— 2^JV» 

Z.« = 2 ("I) 



2 P(y,\u)Y\e^ (l -*' L ^ 



and similarly: 



f(y,.L 0 ,L 2 .Q = \og^ ^ . . (112) 

Z p(y,\u)Y\e H)<L "* L * > 



L k = f(y 2 ,L 0 .L,,k)+ La,* L, k (U3) 

z ^iw^n^'^ 1 ^ 

t:uk°l 



A solution to this equation is: 

Z i *=/^ / ,Z 0 ,Z 2 ,^ (115) 

10 L2 lc =f(y 2 ,Io.L l ,ty (H6) 

for k=].2 t ...,n. The final decision is based on: 

L k = Lok+L 2k (117) 
which is passed through a hard linuter with zero threshold. 

Hie nonlinear equations can be solve using the iterative procedure: 

15 LT" = cc<r > f(y 1 ,Lo,L7 , ,Q (118) 

LT° = aT>/(y„L 0 ,LT ) ,k) (H9) 

The recursion can be started with the initial condition: 

Lf-Lf-Lo 020) 
For each iteration a/" 0 and aj" 0 can be optimized or set to 7 for simplicity. 
20 4.2.3. Design of the interleaver for PMCCC. 

In a PMCCC the interleaver establishes a relationship between portions of a codeword. It is generally assumed that 
when a PMCCC decoder is operating at low bit error rates, error sequences have small Hamming weights. From this, and 
properties of PMCCC, a mathematical structure is possible to developed for interleaver design, permitting the identification of 
quantitatively optimal interleaver. Simulations show the math captures some but not all the essential characteristics of a 
25 successful interleaver. Modifying a random interleaver according to some mathematical ideas gives excellent simulation 
results. 

The function of the interleaver in the PMCCC is to assure that at least one of the codeword components has high 

Hamming weight. For a better PMCCC, we can design an interleaver of permutation length p that rnaximizes the minimum 

Hamming weight generated by weight two inputs. This requires maximizing: 

30 a a s min \j - i I - ; n (j) - n (i) \ I <> ij <, p (121) 

*-J 

where % is the interleaver function. It is also possible to replace the sum with the maximum of: 
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5/r s min \j : - i <\ v | n (j) - n (i) \ I < ij £ p (122) 

An alternate method for interleaver design is to disperse symbols as widely as possible in a 'constellation way". One effective 
method is to choose Si and and generate n one point at a time. For each i e [l,p] y taken sequentially, random values are 
considered for 7t(i) until one is found satisfying for s x =ss. In Figure 85, it is shown how in curve d the floor error can be 
5 avoided using this method. 

The constellation of the interleaver used to obtain curve *VT* is presented in Figure 86. 
4.2.4- Simulations. 

Simulations with: 
(a) two equal, recursive convolutional consistent codes 
10 (b) with 16 states, 

(c) interleaver of length 4096 and 1 6384 

(d) using S-random permutation with S=3 1 and S=40 

(e) running each simulation at least 25 Mbits, 

shows that the decoding algorithm converges down to BER=10 5 at Et/N a below 1 dB with nine iterations. 
15 4.3. Serial Multiple Concatenated Convolutional Codes: 
4.3.1 Encoder 

An SMCCC Encoder comprises of two serial concatenated recursive systematic convolutional encoders separated by 
an interleaver. The encoders are arranged in a "serial concatenation". The concatenated recursive systematic convolutional 
encoders are identical. 

20 Figure 87 represents the proposed encoder. A SMCCC encoder is a combination of two simple encoders. The input 

is a block of information bits. The two encoders generate parity symbols {u 0 and u o) from two simple recursive convolutional 
codes. The key innovation of this technique is an interleaver "f , which permutes the original information bits before input to 
the second encoder. The permutation allows those input sequences for which one encoder produces low-weight codewords 
which will usually cause the other encoder to produce high-weight codewords. Thus, even though the constituent codes are 

25 individually weak, the combination is surprisingly powerful. The resulting code has features similar to a ''random" block code. 

In this way, we have the information symbols (u/ and io) and two redundant symbols (uo and u 7>). With this 
redundancy it is possible to reach longer loops and to reduce the peak to average ratio (PAR) , at the cost of a slight increase of 
the constellation encoder . 

In Figure 83 we present the conversion that we propose, taking into account the new parity bit. 

30 4.3.2 Decoder 

In Figure 88, the block diagram of an iterative decoder is shown. It is based on two modules denoted by "SISO" one 
for each encoder, an interleaver, and a deinterleaver. The SISO module is a four-port device, with two inputs and two outputs. 
It accepts as inputs the probability distributions of the information and code symbols labeling the edges of the code trellis, and 
forms as outputs an update of these distributions based upon the code constraints. The updated probabilities of the input and 

35 code symbols are used in the decoding procedure. 

The SISO module is a four-port device that accepts at the input the sequences of probability distributions and outputs 
the sequences of probability distributions based on its inputs and on its knowledge of the code. The output probability 
distributions represent a smoothed version of the input distributions. The algorithm is completely general and capable of 
coping with parallel edges and also with encoders with rates greater than one, like those encountered in some concatenated 

40 schemes. 

The SISO algorithm requires that the whole sequence has been received before starting the smoothing process. The 
reason is that backward recursion starts from the final trellis state. A more flexible decoding strategy is offered by modifying 
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the algorithm in such a way that the SISO module operates on a fixed memory span and outputs the smoothed probability 
distributions after a given delay, D. This new algorithm is called the sliding-window soft-input soft-output (SW-SISO) 
algorithm 

The SW-SISO algorithm solves the problems of continuously updating the probability distributions, without requiring 
5 trellis terminations. Their computational complexity in some cases is around 5 times that of other suboptimal algorithms like 
SOVA. This is due mainly to the fact that they are multiplicative algorithms. In this section, we overcome this drawback by 
proposing the additive version of the SISO algorithm. 
4.3.3. Interleaver design. 

SMCCC does not have a problem with floor errors as does PMCCC. The floor error begins after 10* 7 that made it 
1 0 suitable for ADSL applications. In an SMCCC the interleaver establishes a relationship between portions of a codeword. For a 
good SMCCC, we can design an interleaver of permutation length ** p " that maximizes the minimum Hamming weight 
generated by weight two inputs. In an SMCCC, the interleaver establishes a relationship between portions of a code-word. In 
the SMCCC case, because one of the inputs come from the outer encoder, the roll of the interleaver is not so critical; for this 
reason the method proposed for the interleaver is to disperse symbols as widely as possible in a "constellation way**. One 
1 5 effective method is to choose for each ie[l,p] x(0=p/3*i. An example of this method is show in Figure 89. 
4.3,4- Simulations. 

Simulations with two equal, recursive convolution^ consistent codes with 16 states and an interleaver of length 
between 100 and 1000 using S-random permutation, and each simulation run examined at least 25 Mbits show that the 
decoding algorithm converges down to BER=10* 7 at Ei/N 0 of below I dB with less than nine iterations. 

20 4.4 The number of iterations in the decoder. 

The number of iterations is a very important subject for the different applications of PMCCC and SMCCC. For 
applications where the delay is not important, a large number is acceptable. For real time applications or for quasi-real time 
applications it is important to use a number of iterations as low as possible maintaining the advantages of this technique. The 
necessary number of iterations depends upon the Et/N Q ratio in the receiver. In Figure 51, we present this relationship for the 

25 SMCCC case, we represent values of Et/N 0 below 0.1 dB, for values around 2 dB it is sufficient to use a number below 10 
iterations. 

4. 5. Comparisons 

The PMCCC has a floor-error around a BER of 10" 6 , The reason for this is that the SMCCC functions in an inner and 
outer encoder structure, while the PMCCC functions as two parallel encoders. In Figure 52 we present the floor error effect for 
30 PMCCC and that SMCCC does not show the floor error effect at least until BER of 10* 9 . For simulation after 10" 9 a lot of time 
is required and it is not possible to give a simulation result. 

5. Reed-Solomon Codes and Turbo Codes for ADSL systems 
5.1 Encoder 

Figure 90 represents the proposed encoder. A PMCCC encoder is a combination of two simple encoders. The input 
35 is a block of information bits. The two encoders generate parity symbols (uo and u* 0 ) from two simple recursive convolutional 
codes. The key innovation of this technique is an interleaver "T\ which permutes the original information bits before input to 
the second encoder. The permutation performed by the interleaver allows those input sequences for which one encoder 
produces low-weight codewords to usually cause the other encoder to produce high-weight codewords. Thus, even though the 
constituent codes are individually weak, the combination is surprisingly powerful. The resulting code has features similar to a 
40 "random" block code. 

In this way, we have the information symbol (uO and two redundant symbols (uo and u\>). With this redundancy it is 
possible to reach longer loops, or works at higher bit rates in the same loop, at the cost of a slight increase of the constellation 
encoder. 
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In a preferred embodiment, the reason we suggest the use two 1/2 convolutional encoders in parallel, is that this 
simplifies the Turbo-code encoder and it still produces results very close to the channel capacity. The use of two 2/3 
convolutional encoders in parallel will produce a little better result (in the order of 0.1 or 0:2 dB) and will increase the 
complexity at least by four. From a practical point of view we think that is not necessary. 

In Figure 83, we have presented the conversion that we propose, taking into account the new parity bit. 
5.2 Decoder. 

In Figure 84, we present the decoder that uses an iterative technique, using two soft-decision input/output trellis 
decoders in each decoding state. The Maximum-a-Posteriori (MAP) Trellis decoder provides the soft output result suitable for 
turbo-code decoding. 
5.3. Simulations. 

In Figure 91, we present the simulation results that we obtained, with two equal, recursive convolutional consistent 
codes with an interleaver of length 400 and K=50. With this value the delay is below 5 msec for 1 .5 Mbit/s assuming a delay of 
3 interleaver. 

The number of Iterations is always below 10. 

The convolutional encoder used is presented in Figure 92. 
6. Forward Error Correction with Low-density paritv-check codes 

Low-density parity-check codes are codes specified by a matrix containing mostly 0's and only a small number of 1 *s. 
In particular, an (n, j, k) low-density code is a code of block length n with a matrix like that of Table 24 where each column 
contains a small fixed number, j, of Ts and each row contains a small fixed number, k, of V s. Note that this type of matrix 
does not have the check digits appearing in diagonal form as in Table 25. However, for coding purposes, the equations 
represented by these matrices can always be solved to give the check digits as explicit sums of information digits. 

Table 24 Example of a low-density code matrix: N = 20. i = 3. k = 4 
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Tables 25. Example of paritv-check matrix. 



INFORMATION CHECK 
DIGITS DIGITS 

* A % 4 ■ , — , H 

X i X% Xz Xi X& 3?« Xj 



1 
1 
1 



1 
1 
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0 <- 

1 ! 



t.b = Xi (3^ X2 © a?3 
— Xi © x% © a?4 
X7 *■ Xi 0 x 3 0 x 4 



These codes are not optimum in the somewhat artificial sense of irunimizing probability of decoding error for a given 
5 block length, and it can be shown that the maximum rate at which these codes can be used is bounded below channel capacity. 
However, a very simple decoding scheme exists for low-density codes, and this compensates for their lack of optimality. 

The analysis of a low-density code of long block length is difficult because of the immense number of code words 
involved. It is simpler to analyze a whole ensemble of such codes because the statistics of an ensemble permit one to average 
over quantities that are not tractable in individual codes. From the ensemble behavior, one can make statistical statements 
10 about the properties of the member codes. Furthermore, one can with high probability find a code with these properties by 
random selection from the ensemble. 

In order to define an ensemble of (n, j, k) low-density codes, consider Table 24 again. Note that the matrix is divided 
into j sub-matrices, each containing a single 1 in each column. The first of these sub-matrices contains all its Fs in descending 
order, i.e., the i* th row contains Vs in columns (i - l)k+ I to ik The other sub-matrices are merely column permutations of the 
1 5 first. We define an ensemble of (n t j\ k) codes as the ensemble resulting from random permutation of the columns of each of the 
bottom j - 1 sub-matrices of a matrix such as Table 24, with equal probability assigned to each permutation. There are two 
interesting results that can be proven using this ensemble, the first concerning the minimum distance of the member codes, and 
the second concerning the probability of decoding error. 

The minimum distance of a code is the number of positions in which the two nearest code words differ. Over the 
20 ensemble, the minimum distance of a member code is a random variable, and it can be shown that the distribution function of 
this random variable can be over bounded by a function. As the block length increases, for fixed j £ 3 and k > j, this function 
approaches a unit step at a fixed fraction <X* of the block length. Thus, for large n, practically all the codes in the ensemble have 
a ininimum distance of at least nS, ky . In Table 26 this ratio of typical rninimum distance to block length is compared to that for a 
parity-check code chosen at random, i.e., with a matrix filled in with equiprobable independent binary digits. It should be noted 
25 that for all the specific nonrandom procedures known for constructing codes, the ratio of rninimum distance to block length 
appears to approach 0 with increasing block length. 

The probability of error using maximum likelihood decoding for low-density codes clearly depends upon the 
particular channel on which the code is being used. The results are particularly simple for the case of the BSC, or binary 
symmetric channel, which is a binary-input, binary-output, memoryless channel with a fixed probability of transition from 
30 either input to the opposite output. Here it can be shown that over a reasonable range of channel transition probabilities, the 
low-density code has a probability of decoding error that decreases exponentially with block length and that the exponent is the 
same as that for the optimum code of slightly higher rate as given in Table 27 . 
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Table 26. Comparison of <fo. the ratio of typical minimum dista nce to block length for an (n. L k^ code, to S. the same ratio for 

an ordinary paritv-check code of the same rate. 
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Table 27. Loss of rate associated with low-densitv codes. 










HATE FOR EQ1 


EJ1VALENT 


i 


k 


Rate 


OPTIMUM 


CODE 



3 6 0,5 0.555 

3 5 0.4 0.43 

4 6 0.333 0.343 
3 4 0.25 0,266 



Although this result for the BSC shows how closely low-density codes approach the optimum, the codes are not 
designed primarily for use on this channel. The BSC is an approximation to physical channels only when there is a receiver that 
makes decisions on the incoming signal on a bit-to-bit basis. Since the decoding procedure to be described later can actually 
use the channel a posteriori probabilities, and since a bit-by-bit decision throws away available information, we are actually 
interested in the probability of decoding error of a binary-input, continuous-output channel. If the noise affects the input 
symbols symmetrically, then this probability can again be bounded by an exponentially decreasing function of the block length, 
but the exponent is a rather complicated function of the channel and code. It is expected that the same type of result holds for a 
wide class of channels with memory, but no analytical results have yet been derived. For channels with memory, it is clearly 
advisable, however, to modify the ensemble somewhat, particularly by permuting the first sub-matrix and possibly by changing 
the probability measure on the permutations. 
7. Application to Modem Communications Systems 

In a preferred embodiment, the use of PMCCC or SMCCC is negotiated independently in each direction of 
communication in the system. In the case of ADSL, this permits the use of trellis code in one direction and a SMCCC code in 
the other direction. 
Computer Program Listing 

This patent application includes a computer program listing containing 37 pages, and included as an appendix. The 
program relates to a Reed-Solomon Encoder and Decoder and a PMCCC Encoder and Decoder for 2 parallel concatenated 
convolutional codes. 

Thus it is seen that the objects, features and advantages of the present invention are efficiently obtained. The 
preferred embodiment described herein is intended to disclose the best mode of the invention and to teach those having 
ordinary skill in the art how to make and use the invention, but should not be interpreted as limiting the scope and spirit of the 
invention as embodied in the appended claims. 
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What We Claim Is: 

1 . A method of forward error correction for communication systems, comprising the following steps: 
producing a symbol stream by forward e r r or coding of a data stream; 

modulating said symbol stream to produce a modulated signal; and, 
transmitting said modulated signal over a communication link. 

2. The method recited in Claim 1 wherein said communication system is a wired system. 

3. The method recited in Claim 1 wherein said communication system is an optical system. 

4. The method recited in Claim 1 wherein the modulating is accomplished with a multi carrier method 

5. The method recited in Claim 4 wherein the multicarrier method is a Discrete Multi-Tone (DMT) method. 

6. The method recited in Claim 1 wherein the modulating is accomplished with a CAP-QAM single carrier method 

7. The method recited in Claim 1 wherein the modulating is accomplished with a Quadrature Amplitude Modulation 
(QAM) method 

8. The method recited in Claim 1 wherein the modulating is accomplished using a Pulse Amplitude Modulation (PAM) 
method. 

9. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 
stream is accomplished with a plurality of convolutional coders. 

10. The method recited in Claim 9 wherein the plurality of convolutional coders are configured in parallel. 

1 1. The method recited in Claim 9 wherein the plurality of convolutional coders are configured in series. 

12. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 
stream is accomplished with a plurality of non-convolutional coders. 

13. The method recited in Claim 12 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

14. The method recited in Claim 12 wherein said non-convolutional coder comprises a low density parity check encoder. 

15. The method recited in Claim 12 wherein the plurality of non-convolutional coders are configured in series. 

16. The method recited in Claim 1 wherein said producing of said symbol stream by forward error coding of a data 
stream is accomplished with a non-convolutional coder and a plurality of convolutional coders. 

17. The method recited in Claim 16 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

18. A method of peak power level reduction for communication systems utilizing a plurality of coders comprising the 
following steps: 

producing a peak reduced signal by encoding said data stream by said plurality of coders; 
modulating said peak reduced signal; and, 
transmitting the modulated peak reduced signal. 

19. A method of forward error correction for communication systems, comprising the following steps: 
producing a symbol stream by forward error coding of a data stream; 

modulating said symbol stream to produce a modulated signal; 
transmitting said modulated signal over a communication link; 

receiving said modulated signal, where said received modulated signal includes errors; 
demodulating said received signal which includes errors; 
decoding said demodulated signal by a plurality of convolutional decoders; and, 
regenerating said data stream and eliminating said errors. 
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20. A method of forward error correction for communication systems, comprising the following steps: 

receiving a modulated signal from a communications link, where said received modulated signal includes errors; 

demodulating said received signal which includes errors; 

decoding said demodulated signal by a plurality of convolutional decoders; and, 

regenerating said data stream and eliminating said errors. 

21. An apparatus for forward error correction for communication systems, comprising: 
means for producing a symbol stream by forward error coding of a data stream; 
means for modulating said symbol stream to produce a modulated signal; and, 
means for transmitting said modulated signal over a communication link. 

22. The apparatus recited in Claim 21 wherein said communication system is a wired system. 

23. The apparatus recited in Claim 2 1 wherein said communication system is an optical system. 

24. The apparatus recited in Claim 2 1 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a plurality of convolutional coders. 

25. The apparatus recited in Claim 24 wherein the plurality of convolutional coders are configured in parallel. 

26. The apparatus recited in Claim 24 wherein the plurality of convolutional coders are configured in series. 

27. The apparatus recited in Claim 21 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a plurality of non-convolutional coders. 

28. The apparatus recited in Claim 27 wherein the plurality of non-convolutional coders are configured in series. 

29. The apparatus recited in Claim 2 1 wherein said means for producing said symbol stream by forward error coding of a 
data stream is accomplished with a non-convolutional coder and a plurality of convolutional coders. 

30. The apparatus recited in Claim 29 wherein said non-convolutional coder comprises a Reed-Solomon Encoder. 

31. An apparatus for accomplishing peak power level reduction for communication systems utilizing a plurality of coders 
comprising: 

means for producing a peak reduced signal by encoding said data stream by said plurality of coders; 
means for modulating said peak reduced signal; and, 
means for transmitting the modulated peak reduced signal. 

32. An apparatus for forward error correction for communication systems, comprising: 

means for receiving a modulated signal from a communications link, where said received modulated signal includes 



errors; 



means for demodulating said received signal which includes errors; 

means for decoding said demodulated signal by a plurality of convolutional decoders, and, 

means for regenerating said data stream and eliminating said errors. 
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